Jul 02 16:55:18.293575 ip-10-0-140-177 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 16:55:18.293588 ip-10-0-140-177 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 16:55:18.293595 ip-10-0-140-177 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 16:55:18.293834 ip-10-0-140-177 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 16:55:28.453724 ip-10-0-140-177 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 16:55:28.453744 ip-10-0-140-177 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7a5f0b8cfd694135a3f0247656cadcb7 -- Jul 02 16:57:27.795112 ip-10-0-140-177 systemd[1]: Starting Kubernetes Kubelet... Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.682925 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690683 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690707 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690715 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690720 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690725 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690730 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690734 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:30.781327 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690738 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690743 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690747 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690750 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690754 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690758 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690762 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690766 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690770 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690774 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690778 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690781 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690785 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690789 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690793 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690796 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690800 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690804 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690808 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690812 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:30.783372 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690816 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690820 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690824 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690828 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690832 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690836 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690839 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690844 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690848 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690852 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690856 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690860 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690863 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690867 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690872 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690878 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690884 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690888 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690892 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690896 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:30.784170 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690901 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690904 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690911 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690915 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690919 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690923 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690926 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690930 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690934 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690938 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690942 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690946 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690950 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690955 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690958 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690962 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690967 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690971 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690975 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690979 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:30.786587 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690984 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690988 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690992 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690996 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.690999 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691003 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691010 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691014 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691017 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691021 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691024 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691028 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691032 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691035 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691040 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691044 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691049 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691053 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691056 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691060 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:30.787384 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691064 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691068 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691072 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691076 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691080 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691085 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691090 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691094 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691098 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691103 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691107 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.691111 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692242 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692262 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692268 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692272 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692290 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692295 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692299 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692304 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:30.788996 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692307 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692311 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692315 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692319 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692322 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692327 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692331 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692335 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692340 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692343 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692347 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692351 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692354 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692358 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692362 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692366 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692370 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692373 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692377 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:30.789779 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692381 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692385 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692389 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692393 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692397 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692401 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692404 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692419 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692424 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692430 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692435 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692439 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692444 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692448 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692453 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692456 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692460 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692464 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:30.790604 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692468 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692472 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692476 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692479 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692485 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692489 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692492 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692496 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692499 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692503 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692507 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692511 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692516 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692520 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692523 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692527 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692531 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692535 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692538 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692542 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:30.791584 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692546 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692550 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692562 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692568 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692572 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692577 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692581 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692585 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692588 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692592 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692596 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692599 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692604 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692608 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692612 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692617 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692622 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692626 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692630 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692633 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:30.793628 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692637 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692641 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692644 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692648 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692652 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692656 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692660 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692665 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692669 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692673 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692676 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692680 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692684 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.692688 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693311 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693318 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693322 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693326 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693330 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693334 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:30.794403 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693338 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693341 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693345 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693349 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693353 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693356 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693360 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693364 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693368 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693372 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693376 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693380 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693384 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693388 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693391 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693395 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693399 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693403 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693407 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693411 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:30.795173 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693415 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693419 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693422 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693426 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693431 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693436 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693439 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693451 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693454 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693458 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693462 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693466 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693469 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693477 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693481 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693485 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693488 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693492 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693496 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693499 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:30.796018 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693503 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693507 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693510 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693513 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693517 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693521 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693525 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693528 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693532 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693536 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693540 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693544 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693551 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693554 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693558 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693562 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693568 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693573 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693577 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:30.912942 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693580 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:30.851835 ip-10-0-140-177 systemd[1]: Started Kubernetes Kubelet. Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693591 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693595 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693599 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693604 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693607 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693612 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693615 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693619 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693623 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693626 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693632 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693638 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693643 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693648 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693652 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693656 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693661 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693665 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:30.914158 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693668 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693671 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693675 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693679 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693684 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693689 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693696 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693700 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693703 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693707 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693711 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693714 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693718 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693722 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.693726 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693833 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693843 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693855 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693862 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693868 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693873 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 16:57:30.916229 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693879 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693885 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693890 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693894 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693899 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693904 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693908 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693914 2582 flags.go:64] FLAG: --cgroup-root="" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693918 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693922 2582 flags.go:64] FLAG: --client-ca-file="" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693926 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693930 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693940 2582 flags.go:64] FLAG: --cluster-domain="" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693944 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693949 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693954 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693959 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693966 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693971 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693976 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693981 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693985 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693990 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693994 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 16:57:30.917055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.693998 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694005 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694012 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694023 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694028 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694033 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694037 2582 flags.go:64] FLAG: --enable-server="true" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694042 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694052 2582 flags.go:64] FLAG: --event-burst="100" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694056 2582 flags.go:64] FLAG: --event-qps="50" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694060 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694065 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694069 2582 flags.go:64] FLAG: --eviction-hard="" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694075 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694079 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694084 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694088 2582 flags.go:64] FLAG: --eviction-soft="" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694093 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694097 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694101 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694106 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694110 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694115 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694119 2582 flags.go:64] FLAG: --feature-gates="" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694124 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 16:57:30.919117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694131 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694136 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694140 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694144 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694148 2582 flags.go:64] FLAG: --help="false" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694153 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-140-177.ec2.internal" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694157 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694162 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694169 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694174 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694179 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694191 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694195 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694200 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694204 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694208 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694212 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694217 2582 flags.go:64] FLAG: --kube-reserved="" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694221 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694225 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694230 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694235 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694238 2582 flags.go:64] FLAG: --lock-file="" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694243 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 16:57:30.919946 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694247 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694251 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694259 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694263 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694267 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694271 2582 flags.go:64] FLAG: --logging-format="text" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694291 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694296 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694302 2582 flags.go:64] FLAG: --manifest-url="" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694307 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694313 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694317 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694323 2582 flags.go:64] FLAG: --max-pods="110" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694329 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694333 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694338 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694344 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694348 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694353 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694357 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694376 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694381 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694385 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 16:57:30.922396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694390 2582 flags.go:64] FLAG: --pod-cidr="" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694394 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694406 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694411 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694415 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694420 2582 flags.go:64] FLAG: --port="10250" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694425 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694429 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e300a51db32145f0" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694434 2582 flags.go:64] FLAG: --qos-reserved="" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694438 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694442 2582 flags.go:64] FLAG: --register-node="true" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694447 2582 flags.go:64] FLAG: --register-with-taints="" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694452 2582 flags.go:64] FLAG: --registry-burst="10" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694456 2582 flags.go:64] FLAG: --registry-qps="5" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694460 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694464 2582 flags.go:64] FLAG: --reserved-memory="" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694469 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694473 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694479 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694483 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694488 2582 flags.go:64] FLAG: --runonce="false" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694492 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694497 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694501 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694506 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 16:57:30.923199 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694512 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694517 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694521 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694526 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694530 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694543 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694548 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694553 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694557 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694561 2582 flags.go:64] FLAG: --system-cgroups="" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694565 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694573 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694578 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694582 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694591 2582 flags.go:64] FLAG: --tls-min-version="" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694595 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694599 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694603 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694607 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694613 2582 flags.go:64] FLAG: --v="2" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694619 2582 flags.go:64] FLAG: --version="false" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694624 2582 flags.go:64] FLAG: --vmodule="" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694630 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.694635 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694843 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:30.926505 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694851 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694856 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694860 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694864 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694868 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694872 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694876 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694883 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694889 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694893 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694897 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694901 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694905 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694918 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694922 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694926 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694930 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694933 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694937 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:30.927334 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694941 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694945 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694949 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694952 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694956 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694960 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694964 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694967 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694971 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694974 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694978 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694982 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694986 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694991 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694995 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.694999 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695004 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695010 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695014 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:30.930195 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695019 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695026 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695030 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695034 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695040 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695044 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695048 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695053 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695064 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695068 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695072 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695076 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695080 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695084 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695088 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695091 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695094 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695098 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695102 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695105 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:30.931010 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695109 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695113 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695117 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695121 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695124 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695127 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695133 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695137 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695141 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695145 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695149 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695152 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695156 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695162 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695166 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695169 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695173 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695177 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695181 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695184 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:30.935518 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695188 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695199 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695203 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695207 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695211 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695214 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695218 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695222 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695226 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695229 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695233 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695237 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695240 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695244 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695248 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695252 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695256 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695259 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695265 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:30.936716 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.695269 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.695936 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.797245 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.797264 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.798064 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.798071 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798135 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798142 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798145 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798148 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798151 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798154 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798158 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798163 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:30.940795 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798166 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798169 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798172 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798175 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798178 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798181 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798183 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798186 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798188 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798191 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798194 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798196 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798199 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798202 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798205 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798209 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798213 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798216 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798219 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798222 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:30.941617 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798224 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798227 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798229 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798232 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798235 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798237 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798240 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798242 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798245 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798248 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798251 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798254 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798257 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798259 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798262 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798264 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798267 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798269 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798273 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798286 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:30.944833 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798289 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798292 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798295 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798297 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798300 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798302 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798305 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798308 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798310 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798313 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798315 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798318 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798321 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798323 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798326 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798328 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798331 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798333 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798336 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798338 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:30.945641 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798341 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798344 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798347 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798349 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798352 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798354 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798357 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798360 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798362 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798364 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798367 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798370 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798373 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798375 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798378 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798380 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798383 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798386 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798388 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798390 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:31.046064 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798393 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798395 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798400 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798404 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798407 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798409 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798412 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798414 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798417 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798420 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798422 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.798428 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798543 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798548 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:31.046845 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798552 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798556 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798559 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798561 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798564 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798566 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798569 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798571 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798574 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798577 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798581 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798584 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798586 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798589 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798592 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798594 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798597 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798599 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798601 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798604 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:31.050504 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798606 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798609 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798611 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798614 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798616 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798619 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798621 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798624 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798626 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798629 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798631 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798634 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798636 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798639 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798641 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798644 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798647 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798650 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798652 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798655 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:31.051307 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798658 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798660 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798663 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798666 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798668 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798671 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798673 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798676 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798678 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798681 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798683 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798686 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798688 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798691 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798693 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798696 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798698 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798701 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798703 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798706 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:31.055318 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798709 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798713 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798716 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798719 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798722 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798725 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798727 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798729 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798732 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798735 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798739 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798742 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798745 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798748 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798751 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798753 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798756 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798759 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798761 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:31.056106 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798764 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798766 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798768 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798771 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798773 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798776 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798778 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798781 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798783 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798788 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798791 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798793 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798796 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798799 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798801 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798804 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798806 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:31.059339 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:30.798809 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.798814 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.798952 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.802944 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.804455 2582 server.go:1019] "Starting client certificate rotation" Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.804561 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.804600 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.807145 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.811033 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.821094 2582 log.go:25] "Validated CRI v1 runtime API" Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.823250 2582 log.go:25] "Validated CRI v1 image API" Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.824043 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 16:57:31.060137 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.826977 2582 fs.go:135] Filesystem UUIDs: map[117f4d7d-31bb-492e-8dd3-f6ff5704f652:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f71d625a-9f55-4b63-a16c-271275c1892a:/dev/nvme0n1p3] Jul 02 16:57:31.062588 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.826996 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 16:57:31.062588 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.832640 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.833961 2582 manager.go:216] Machine: {Timestamp:2026-07-02 16:57:30.832500797 +0000 UTC m=+1.386343211 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3083376 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22885ebf1af5f678966b21fc329890 SystemUUID:ec22885e-bf1a-f5f6-7896-6b21fc329890 BootID:7a5f0b8c-fd69-4135-a3f0-247656cadcb7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:be:ea:a9:5b:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:be:ea:a9:5b:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:41:9b:8c:a2:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.834056 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.834165 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.836516 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.836540 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.837232 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.837241 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.837249 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.838052 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.838852 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.841895 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.842002 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.842029 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.842038 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.842052 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.842063 2582 kubelet.go:398] "Adding apiserver pod source" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.842071 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 16:57:31.066661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.842434 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.842449 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.844682 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.846474 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.846502 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847311 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847325 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847331 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847336 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847343 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847349 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847376 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847381 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847388 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847393 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847401 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847409 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847442 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.847447 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.850942 2582 server.go:1268] "Started kubelet" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.850993 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.851074 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.851146 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:30.851617 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:30.851646 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.851662 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.852431 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.853728 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:30.857502 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:30.858555 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-177.ec2.internal.18be8777be6b0826 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-177.ec2.internal,UID:ip-10-0-140-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-177.ec2.internal,},FirstTimestamp:2026-07-02 16:57:30.850838566 +0000 UTC m=+1.404680979,LastTimestamp:2026-07-02 16:57:30.850838566 +0000 UTC m=+1.404680979,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-177.ec2.internal,}" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.859942 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.859958 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:30.860121 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.860475 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.860511 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.860526 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.860624 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.860632 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.860674 2582 factory.go:55] Registering systemd factory Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.860689 2582 factory.go:223] Registration of the systemd container factory successfully Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.861192 2582 factory.go:153] Registering CRI-O factory Jul 02 16:57:31.067478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.861204 2582 factory.go:223] Registration of the crio container factory successfully Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.861247 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.861273 2582 factory.go:103] Registering Raw factory Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.861307 2582 manager.go:1196] Started watching for new ooms in manager Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.861685 2582 manager.go:349] Starting recovery of all containers Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:30.862614 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:30.862698 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.865441 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d6qlt" Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.870112 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d6qlt" Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.872785 2582 manager.go:354] Recovery completed Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:30.879256 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:30.960168 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:31.073121 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.061164 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:31.408972 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.408924 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:31.409942 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.409918 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:31.410045 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.409961 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:31.410045 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.409976 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:31.410612 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.410593 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 16:57:31.410612 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.410609 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 16:57:31.410752 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.410629 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 02 16:57:31.410752 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.410651 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:31.411436 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.411418 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:31.411477 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.411448 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:31.411477 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.411462 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:31.411878 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.411866 2582 policy_none.go:49] "None policy: Start" Jul 02 16:57:31.412446 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.412434 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 16:57:31.412499 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.412459 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 16:57:31.413700 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.413686 2582 policy_none.go:47] "Start" Jul 02 16:57:31.418428 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.418411 2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-177.ec2.internal\" not found" node="ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.461175 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.461040 2582 manager.go:337] "Starting Device Plugin manager" Jul 02 16:57:31.461315 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.461196 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 16:57:31.461315 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.461213 2582 server.go:87] "Starting device plugin registration server" Jul 02 16:57:31.461470 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.461459 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 16:57:31.461501 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.461472 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 16:57:31.461574 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.461558 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 16:57:31.461679 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.461667 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 16:57:31.461734 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.461682 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 16:57:31.464090 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.464069 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 16:57:31.464161 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.464124 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:31.562622 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.562576 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:31.563729 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.563712 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:31.563847 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.563746 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:31.563847 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.563761 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:31.563847 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.563796 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.570516 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.570498 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.570610 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.570521 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-177.ec2.internal\": node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:31.601118 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.601095 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:31.613415 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.610308 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 16:57:31.613415 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.611566 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 16:57:31.613415 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.611602 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 16:57:31.613415 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.611626 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 16:57:31.613415 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.611660 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 16:57:31.614513 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.614496 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:31.702152 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.702072 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:31.712363 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.712344 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-177.ec2.internal"] Jul 02 16:57:31.712445 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.712436 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:31.714112 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.714096 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:31.714198 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.714127 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:31.714198 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.714138 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:31.716004 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.715992 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:31.716123 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.716108 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.716180 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.716138 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:31.716700 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.716680 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:31.716700 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.716694 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:31.716832 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.716710 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:31.716832 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.716717 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:31.716832 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.716722 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:31.716832 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.716726 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:31.718318 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.718305 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.718384 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.718327 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:31.718966 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.718943 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:31.719044 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.718972 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:31.719044 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.718987 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:31.751953 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.751933 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-177.ec2.internal\" not found" node="ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.755233 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.755218 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-177.ec2.internal\" not found" node="ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.802309 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.802271 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:31.803366 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.803352 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 16:57:31.803493 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.803473 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 16:57:31.803546 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.803453 2582 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a0982126e3c4d4300aa49bdc444c76df-0aa7d40c4aa2717d.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-140-177.ec2.internal.18be8777dfbee22d\": read tcp 10.0.140.177:46006->3.221.67.145:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-140-177.ec2.internal.18be8777dfbee22d default 6542 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-177.ec2.internal,UID:ip-10-0-140-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-177.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-177.ec2.internal,},FirstTimestamp:2026-07-02 16:57:31 +0000 UTC,LastTimestamp:2026-07-02 16:57:31.716726011 +0000 UTC m=+2.270568424,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-177.ec2.internal,}" Jul 02 16:57:31.810690 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.810672 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f058c965328c85502b30c600a403fbe5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal\" (UID: \"f058c965328c85502b30c600a403fbe5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.810770 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.810697 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f058c965328c85502b30c600a403fbe5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal\" (UID: \"f058c965328c85502b30c600a403fbe5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.810770 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.810713 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17401ed3249bf6dca968e66b7a400752-config\") pod \"kube-apiserver-proxy-ip-10-0-140-177.ec2.internal\" (UID: \"17401ed3249bf6dca968e66b7a400752\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.842783 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.842759 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:31.902889 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:31.902864 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:31.911054 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.911031 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17401ed3249bf6dca968e66b7a400752-config\") pod \"kube-apiserver-proxy-ip-10-0-140-177.ec2.internal\" (UID: \"17401ed3249bf6dca968e66b7a400752\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.911109 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.911059 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f058c965328c85502b30c600a403fbe5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal\" (UID: \"f058c965328c85502b30c600a403fbe5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.911109 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.911075 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f058c965328c85502b30c600a403fbe5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal\" (UID: \"f058c965328c85502b30c600a403fbe5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.911178 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.911125 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f058c965328c85502b30c600a403fbe5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal\" (UID: \"f058c965328c85502b30c600a403fbe5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.911178 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.911132 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17401ed3249bf6dca968e66b7a400752-config\") pod \"kube-apiserver-proxy-ip-10-0-140-177.ec2.internal\" (UID: \"17401ed3249bf6dca968e66b7a400752\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-177.ec2.internal" Jul 02 16:57:31.911178 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:31.911147 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f058c965328c85502b30c600a403fbe5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal\" (UID: \"f058c965328c85502b30c600a403fbe5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" Jul 02 16:57:32.003428 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:32.003356 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:32.055685 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.055661 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" Jul 02 16:57:32.059315 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.059173 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-177.ec2.internal" Jul 02 16:57:32.103607 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:32.103570 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:32.103607 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.103582 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 16:52:30 +0000 UTC" deadline="2028-01-16 17:44:01.342911294 +0000 UTC" Jul 02 16:57:32.103607 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.103615 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13512h46m29.239300563s" Jul 02 16:57:32.152760 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.152724 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:32.204174 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:32.204142 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:32.304726 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:32.304659 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-177.ec2.internal\" not found" Jul 02 16:57:32.366731 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.366699 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:32.460421 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.460394 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" Jul 02 16:57:32.476385 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.476363 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 16:57:32.477390 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.477377 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-177.ec2.internal" Jul 02 16:57:32.485539 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.485515 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 16:57:32.546476 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:32.546433 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf058c965328c85502b30c600a403fbe5.slice/crio-611e3670f9b49970b58eebd77e09d5c71eab885b50cca986155e19baaf79fce6 WatchSource:0}: Error finding container 611e3670f9b49970b58eebd77e09d5c71eab885b50cca986155e19baaf79fce6: Status 404 returned error can't find the container with id 611e3670f9b49970b58eebd77e09d5c71eab885b50cca986155e19baaf79fce6 Jul 02 16:57:32.554218 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.554186 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 16:57:32.562161 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:32.562140 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17401ed3249bf6dca968e66b7a400752.slice/crio-0578f3a2ea2a6cdfb0112eb0c7313729f605914dbecae18e8b097383ab9a8ab6 WatchSource:0}: Error finding container 0578f3a2ea2a6cdfb0112eb0c7313729f605914dbecae18e8b097383ab9a8ab6: Status 404 returned error can't find the container with id 0578f3a2ea2a6cdfb0112eb0c7313729f605914dbecae18e8b097383ab9a8ab6 Jul 02 16:57:32.614932 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.614884 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-177.ec2.internal" event={"ID":"17401ed3249bf6dca968e66b7a400752","Type":"ContainerStarted","Data":"0578f3a2ea2a6cdfb0112eb0c7313729f605914dbecae18e8b097383ab9a8ab6"} Jul 02 16:57:32.615895 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.615870 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" event={"ID":"f058c965328c85502b30c600a403fbe5","Type":"ContainerStarted","Data":"611e3670f9b49970b58eebd77e09d5c71eab885b50cca986155e19baaf79fce6"} Jul 02 16:57:32.841123 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.841046 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:32.843092 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.843079 2582 apiserver.go:52] "Watching apiserver" Jul 02 16:57:32.852771 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.852754 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 16:57:32.853977 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.853958 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-w829v","openshift-multus/multus-q8rf6","openshift-multus/network-metrics-daemon-sgz5v","openshift-network-diagnostics/network-check-target-69vq4","kube-system/konnectivity-agent-r2xq2","kube-system/kube-apiserver-proxy-ip-10-0-140-177.ec2.internal","openshift-cluster-node-tuning-operator/tuned-82cs4","openshift-image-registry/node-ca-pdg2b","openshift-network-operator/iptables-alerter-nrpdh","openshift-ovn-kubernetes/ovnkube-node-h47wm","kube-system/global-pull-secret-syncer-qrjtq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8","openshift-dns/node-resolver-bvvxz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal"] Jul 02 16:57:32.855597 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.855577 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.856615 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.856597 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bvvxz" Jul 02 16:57:32.857628 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.857610 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:32.857706 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:32.857668 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:32.858681 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.858640 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:32.858771 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:32.858724 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:32.859772 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.859752 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:32.860869 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.860850 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 16:57:32.861004 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.860987 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pdg2b" Jul 02 16:57:32.862439 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.862426 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:32.863877 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.863861 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:32.864897 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.864881 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 16:57:32.865101 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.865083 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 16:57:32.865517 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.865501 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q8rf6" Jul 02 16:57:32.865893 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.865873 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 16:57:32.865975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.865949 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:57:32.866926 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.866910 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:32.868319 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.868271 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:32.868852 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:32.868371 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:32.869469 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.869453 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nrpdh" Jul 02 16:57:32.875961 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.875939 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 16:57:32.875961 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.875952 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 16:57:32.876083 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.875989 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 16:57:32.877302 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.876945 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 16:57:32.878414 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.878392 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jf8k9\"" Jul 02 16:57:32.878602 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.878585 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fz57q\"" Jul 02 16:57:32.878888 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.878868 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wk22h\"" Jul 02 16:57:32.878952 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.878885 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nsfc2\"" Jul 02 16:57:32.879179 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.879161 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 16:57:32.879713 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.879690 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 16:57:32.880161 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.880145 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 16:57:32.880982 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.880694 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 16:57:32.880982 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.880839 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 16:57:32.880982 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.880858 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rvxnr\"" Jul 02 16:57:32.880982 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.880950 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 16:57:32.881238 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.881034 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 16:57:32.881238 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.881072 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 16:57:32.881238 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.881152 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 16:57:32.881238 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.881199 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 16:57:32.881471 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.881250 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 16:57:32.882000 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.881821 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 16:57:32.882000 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.881844 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 16:57:32.882000 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.881859 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jd5tb\"" Jul 02 16:57:32.882000 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.881924 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 16:57:32.882000 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.881854 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5nnvx\"" Jul 02 16:57:32.882296 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.882169 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 16:57:32.882296 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.882220 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:57:32.882296 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.882247 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-snqsg\"" Jul 02 16:57:32.882460 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.882431 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-59qcx\"" Jul 02 16:57:32.882649 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.882635 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 16:57:32.882741 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.882727 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 16:57:32.890021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.890004 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 16:57:32.891354 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.891336 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 16:57:32.915330 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915306 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-run\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915425 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915339 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-host\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915425 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915357 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-tuned\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915425 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915373 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae654452-b41a-4ef8-9c54-b29a75d6d251-tmp-dir\") pod \"node-resolver-bvvxz\" (UID: \"ae654452-b41a-4ef8-9c54-b29a75d6d251\") " pod="openshift-dns/node-resolver-bvvxz" Jul 02 16:57:32.915425 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915397 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n24r9\" (UniqueName: \"kubernetes.io/projected/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-kube-api-access-n24r9\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:32.915631 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915451 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b317bb03-701a-42dc-94c2-91b9150c56b2-serviceca\") pod \"node-ca-pdg2b\" (UID: \"b317bb03-701a-42dc-94c2-91b9150c56b2\") " pod="openshift-image-registry/node-ca-pdg2b" Jul 02 16:57:32.915631 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915480 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csxc2\" (UniqueName: \"kubernetes.io/projected/b317bb03-701a-42dc-94c2-91b9150c56b2-kube-api-access-csxc2\") pod \"node-ca-pdg2b\" (UID: \"b317bb03-701a-42dc-94c2-91b9150c56b2\") " pod="openshift-image-registry/node-ca-pdg2b" Jul 02 16:57:32.915631 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915500 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-lib-modules\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915631 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915519 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0664f46-9e9d-458a-8b78-3ea8387ebc93-tmp\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915631 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915542 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-kubernetes\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915631 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915577 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-sysctl-d\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915631 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-systemd\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915639 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-sys\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915662 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-var-lib-kubelet\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915684 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915706 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-sysctl-conf\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915728 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99224f0f-3094-411d-85c2-09d94b6150b2-agent-certs\") pod \"konnectivity-agent-r2xq2\" (UID: \"99224f0f-3094-411d-85c2-09d94b6150b2\") " pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915752 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99224f0f-3094-411d-85c2-09d94b6150b2-konnectivity-ca\") pod \"konnectivity-agent-r2xq2\" (UID: \"99224f0f-3094-411d-85c2-09d94b6150b2\") " pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915775 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-modprobe-d\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915805 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-sysconfig\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915828 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9mnt\" (UniqueName: \"kubernetes.io/projected/b0664f46-9e9d-458a-8b78-3ea8387ebc93-kube-api-access-x9mnt\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915851 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ae654452-b41a-4ef8-9c54-b29a75d6d251-hosts-file\") pod \"node-resolver-bvvxz\" (UID: \"ae654452-b41a-4ef8-9c54-b29a75d6d251\") " pod="openshift-dns/node-resolver-bvvxz" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915885 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r5b8\" (UniqueName: \"kubernetes.io/projected/ae654452-b41a-4ef8-9c54-b29a75d6d251-kube-api-access-8r5b8\") pod \"node-resolver-bvvxz\" (UID: \"ae654452-b41a-4ef8-9c54-b29a75d6d251\") " pod="openshift-dns/node-resolver-bvvxz" Jul 02 16:57:32.915939 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915929 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7khb\" (UniqueName: \"kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb\") pod \"network-check-target-69vq4\" (UID: \"f280972d-5590-4286-9c11-cc896f1ec909\") " pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:32.916359 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.915960 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b317bb03-701a-42dc-94c2-91b9150c56b2-host\") pod \"node-ca-pdg2b\" (UID: \"b317bb03-701a-42dc-94c2-91b9150c56b2\") " pod="openshift-image-registry/node-ca-pdg2b" Jul 02 16:57:32.935023 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.934990 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d7cv5" Jul 02 16:57:32.955028 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.955009 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d7cv5" Jul 02 16:57:32.961388 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:32.961370 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 16:57:33.016318 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016291 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/330e39e4-88da-45b3-a74a-e7257717a1cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.016318 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-socket-dir-parent\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.016318 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016337 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dhzv\" (UniqueName: \"kubernetes.io/projected/44482e98-a4ab-4a66-a839-b3ef7709754e-kube-api-access-5dhzv\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.016575 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016355 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-run-ovn-kubernetes\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.016575 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016393 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.016575 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016418 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-sysctl-d\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.016575 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:33.016575 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016463 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-conf-dir\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.016575 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016487 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-slash\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.016575 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016537 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-run-ovn\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016578 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-sys-fs\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r5b8\" (UniqueName: \"kubernetes.io/projected/ae654452-b41a-4ef8-9c54-b29a75d6d251-kube-api-access-8r5b8\") pod \"node-resolver-bvvxz\" (UID: \"ae654452-b41a-4ef8-9c54-b29a75d6d251\") " pod="openshift-dns/node-resolver-bvvxz" Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016631 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-run-netns\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-run-multus-certs\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.016647 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016660 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03c56d11-4b60-4145-9d95-4bed2230614c-env-overrides\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016690 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03c56d11-4b60-4145-9d95-4bed2230614c-ovnkube-script-lib\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016609 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-sysctl-d\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.016742 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs podName:0bc791e4-fe53-4c4e-b672-e9e64c4a01f7 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:33.51670273 +0000 UTC m=+4.070545144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs") pod "network-metrics-daemon-sgz5v" (UID: "0bc791e4-fe53-4c4e-b672-e9e64c4a01f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016764 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-device-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016796 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-cnibin\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016820 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-var-lib-kubelet\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.016894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016866 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-hostroot\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016898 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-etc-openvswitch\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016939 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-log-socket\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016960 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-cnibin\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.016988 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csxc2\" (UniqueName: \"kubernetes.io/projected/b317bb03-701a-42dc-94c2-91b9150c56b2-kube-api-access-csxc2\") pod \"node-ca-pdg2b\" (UID: \"b317bb03-701a-42dc-94c2-91b9150c56b2\") " pod="openshift-image-registry/node-ca-pdg2b" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017011 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-lib-modules\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017033 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-systemd-units\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017061 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-run-openvswitch\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017091 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017133 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-daemon-config\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017180 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-lib-modules\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017187 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-registration-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017239 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-sysctl-conf\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-modprobe-d\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017306 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03c56d11-4b60-4145-9d95-4bed2230614c-ovn-node-metrics-cert\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.017478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017345 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-socket-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017369 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-sysctl-conf\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017368 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-run\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017399 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-modprobe-d\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-var-lib-cni-bin\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017436 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-run-systemd\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017442 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-run\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017492 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-var-lib-cni-multus\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017531 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-kubelet\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017556 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-var-lib-openvswitch\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017581 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-cni-bin\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017605 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017631 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/330e39e4-88da-45b3-a74a-e7257717a1cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-kubernetes\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017683 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-systemd\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017706 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-sys\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017729 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-var-lib-kubelet\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.018167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017744 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-kubernetes\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017752 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-systemd\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017755 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-system-cni-dir\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017812 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-cni-dir\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017814 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-sys\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017837 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44482e98-a4ab-4a66-a839-b3ef7709754e-cni-binary-copy\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017860 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-node-log\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017863 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-var-lib-kubelet\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017885 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99224f0f-3094-411d-85c2-09d94b6150b2-konnectivity-ca\") pod \"konnectivity-agent-r2xq2\" (UID: \"99224f0f-3094-411d-85c2-09d94b6150b2\") " pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017918 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ae654452-b41a-4ef8-9c54-b29a75d6d251-hosts-file\") pod \"node-resolver-bvvxz\" (UID: \"ae654452-b41a-4ef8-9c54-b29a75d6d251\") " pod="openshift-dns/node-resolver-bvvxz" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017941 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-etc-kubernetes\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017964 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-cni-netd\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.017986 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p59g8\" (UniqueName: \"kubernetes.io/projected/03c56d11-4b60-4145-9d95-4bed2230614c-kube-api-access-p59g8\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018015 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86599ea7-2553-4aa7-882e-0f60ddb1b31b-host-slash\") pod \"iptables-alerter-nrpdh\" (UID: \"86599ea7-2553-4aa7-882e-0f60ddb1b31b\") " pod="openshift-network-operator/iptables-alerter-nrpdh" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018039 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp4cq\" (UniqueName: \"kubernetes.io/projected/86599ea7-2553-4aa7-882e-0f60ddb1b31b-kube-api-access-cp4cq\") pod \"iptables-alerter-nrpdh\" (UID: \"86599ea7-2553-4aa7-882e-0f60ddb1b31b\") " pod="openshift-network-operator/iptables-alerter-nrpdh" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018061 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-os-release\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018085 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-host\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.019021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018110 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae654452-b41a-4ef8-9c54-b29a75d6d251-tmp-dir\") pod \"node-resolver-bvvxz\" (UID: \"ae654452-b41a-4ef8-9c54-b29a75d6d251\") " pod="openshift-dns/node-resolver-bvvxz" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018132 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-os-release\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018156 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtvjg\" (UniqueName: \"kubernetes.io/projected/f4c160db-c866-4b8f-ae6d-2674197141a3-kube-api-access-wtvjg\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018210 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh4m2\" (UniqueName: \"kubernetes.io/projected/330e39e4-88da-45b3-a74a-e7257717a1cc-kube-api-access-mh4m2\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018226 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ae654452-b41a-4ef8-9c54-b29a75d6d251-hosts-file\") pod \"node-resolver-bvvxz\" (UID: \"ae654452-b41a-4ef8-9c54-b29a75d6d251\") " pod="openshift-dns/node-resolver-bvvxz" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018247 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-host\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018251 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/266386cf-6c7a-4cba-8514-14997ab0e3b2-dbus\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018304 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b317bb03-701a-42dc-94c2-91b9150c56b2-serviceca\") pod \"node-ca-pdg2b\" (UID: \"b317bb03-701a-42dc-94c2-91b9150c56b2\") " pod="openshift-image-registry/node-ca-pdg2b" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018338 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0664f46-9e9d-458a-8b78-3ea8387ebc93-tmp\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018378 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03c56d11-4b60-4145-9d95-4bed2230614c-ovnkube-config\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86599ea7-2553-4aa7-882e-0f60ddb1b31b-iptables-alerter-script\") pod \"iptables-alerter-nrpdh\" (UID: \"86599ea7-2553-4aa7-882e-0f60ddb1b31b\") " pod="openshift-network-operator/iptables-alerter-nrpdh" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018455 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-system-cni-dir\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018479 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/330e39e4-88da-45b3-a74a-e7257717a1cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018504 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/266386cf-6c7a-4cba-8514-14997ab0e3b2-kubelet-config\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018526 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-run-netns\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018531 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae654452-b41a-4ef8-9c54-b29a75d6d251-tmp-dir\") pod \"node-resolver-bvvxz\" (UID: \"ae654452-b41a-4ef8-9c54-b29a75d6d251\") " pod="openshift-dns/node-resolver-bvvxz" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:33.019739 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018600 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99224f0f-3094-411d-85c2-09d94b6150b2-konnectivity-ca\") pod \"konnectivity-agent-r2xq2\" (UID: \"99224f0f-3094-411d-85c2-09d94b6150b2\") " pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99224f0f-3094-411d-85c2-09d94b6150b2-agent-certs\") pod \"konnectivity-agent-r2xq2\" (UID: \"99224f0f-3094-411d-85c2-09d94b6150b2\") " pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018637 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-sysconfig\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018755 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mnt\" (UniqueName: \"kubernetes.io/projected/b0664f46-9e9d-458a-8b78-3ea8387ebc93-kube-api-access-x9mnt\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018785 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b317bb03-701a-42dc-94c2-91b9150c56b2-serviceca\") pod \"node-ca-pdg2b\" (UID: \"b317bb03-701a-42dc-94c2-91b9150c56b2\") " pod="openshift-image-registry/node-ca-pdg2b" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018768 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n24r9\" (UniqueName: \"kubernetes.io/projected/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-kube-api-access-n24r9\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018940 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-run-k8s-cni-cncf-io\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.018798 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-sysconfig\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.019064 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7khb\" (UniqueName: \"kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb\") pod \"network-check-target-69vq4\" (UID: \"f280972d-5590-4286-9c11-cc896f1ec909\") " pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.019089 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b317bb03-701a-42dc-94c2-91b9150c56b2-host\") pod \"node-ca-pdg2b\" (UID: \"b317bb03-701a-42dc-94c2-91b9150c56b2\") " pod="openshift-image-registry/node-ca-pdg2b" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.019124 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-tuned\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.020443 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.019216 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b317bb03-701a-42dc-94c2-91b9150c56b2-host\") pod \"node-ca-pdg2b\" (UID: \"b317bb03-701a-42dc-94c2-91b9150c56b2\") " pod="openshift-image-registry/node-ca-pdg2b" Jul 02 16:57:33.022216 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.022176 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0664f46-9e9d-458a-8b78-3ea8387ebc93-tmp\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.022316 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.022226 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0664f46-9e9d-458a-8b78-3ea8387ebc93-etc-tuned\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.022434 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.022416 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99224f0f-3094-411d-85c2-09d94b6150b2-agent-certs\") pod \"konnectivity-agent-r2xq2\" (UID: \"99224f0f-3094-411d-85c2-09d94b6150b2\") " pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:33.035957 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.035934 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:33.036055 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.035963 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:33.036055 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.035976 2582 projected.go:196] Error preparing data for projected volume kube-api-access-p7khb for pod openshift-network-diagnostics/network-check-target-69vq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:33.036055 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.036031 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb podName:f280972d-5590-4286-9c11-cc896f1ec909 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:33.536014214 +0000 UTC m=+4.089856630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p7khb" (UniqueName: "kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb") pod "network-check-target-69vq4" (UID: "f280972d-5590-4286-9c11-cc896f1ec909") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:33.037718 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.037440 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9mnt\" (UniqueName: \"kubernetes.io/projected/b0664f46-9e9d-458a-8b78-3ea8387ebc93-kube-api-access-x9mnt\") pod \"tuned-82cs4\" (UID: \"b0664f46-9e9d-458a-8b78-3ea8387ebc93\") " pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.037718 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.037676 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r5b8\" (UniqueName: \"kubernetes.io/projected/ae654452-b41a-4ef8-9c54-b29a75d6d251-kube-api-access-8r5b8\") pod \"node-resolver-bvvxz\" (UID: \"ae654452-b41a-4ef8-9c54-b29a75d6d251\") " pod="openshift-dns/node-resolver-bvvxz" Jul 02 16:57:33.038120 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.038103 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n24r9\" (UniqueName: \"kubernetes.io/projected/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-kube-api-access-n24r9\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:33.038359 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.038294 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csxc2\" (UniqueName: \"kubernetes.io/projected/b317bb03-701a-42dc-94c2-91b9150c56b2-kube-api-access-csxc2\") pod \"node-ca-pdg2b\" (UID: \"b317bb03-701a-42dc-94c2-91b9150c56b2\") " pod="openshift-image-registry/node-ca-pdg2b" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120097 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dhzv\" (UniqueName: \"kubernetes.io/projected/44482e98-a4ab-4a66-a839-b3ef7709754e-kube-api-access-5dhzv\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120143 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-run-ovn-kubernetes\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120170 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120205 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-conf-dir\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-slash\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120235 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-run-ovn\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120250 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-sys-fs\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-run-netns\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120301 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-run-multus-certs\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120343 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03c56d11-4b60-4145-9d95-4bed2230614c-env-overrides\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120357 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03c56d11-4b60-4145-9d95-4bed2230614c-ovnkube-script-lib\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120373 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-device-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120399 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-cnibin\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120417 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-var-lib-kubelet\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120439 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-hostroot\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120439 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.121661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120446 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-run-ovn\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120464 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-etc-openvswitch\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120482 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-log-socket\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120505 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-cnibin\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-systemd-units\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120528 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-conf-dir\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120556 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-device-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120567 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-slash\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120600 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-run-openvswitch\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120611 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-sys-fs\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120613 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-cnibin\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120648 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-var-lib-kubelet\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120656 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120673 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-run-multus-certs\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120691 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-hostroot\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120695 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-daemon-config\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120736 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-etc-openvswitch\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.122616 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120784 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-log-socket\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120825 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-cnibin\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120502 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-run-ovn-kubernetes\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120872 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-systemd-units\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120962 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.120998 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-run-openvswitch\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121039 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-run-netns\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121083 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03c56d11-4b60-4145-9d95-4bed2230614c-env-overrides\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-registration-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121153 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03c56d11-4b60-4145-9d95-4bed2230614c-ovn-node-metrics-cert\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121169 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121178 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-socket-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-var-lib-cni-bin\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121219 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-registration-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121229 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-run-systemd\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121233 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-daemon-config\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121254 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-var-lib-cni-multus\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.123526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121306 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-kubelet\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121334 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-var-lib-openvswitch\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121359 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-cni-bin\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121383 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/330e39e4-88da-45b3-a74a-e7257717a1cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121436 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-system-cni-dir\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121460 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-cni-dir\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121485 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44482e98-a4ab-4a66-a839-b3ef7709754e-cni-binary-copy\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121507 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-node-log\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121533 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-etc-kubernetes\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-cni-netd\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p59g8\" (UniqueName: \"kubernetes.io/projected/03c56d11-4b60-4145-9d95-4bed2230614c-kube-api-access-p59g8\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86599ea7-2553-4aa7-882e-0f60ddb1b31b-host-slash\") pod \"iptables-alerter-nrpdh\" (UID: \"86599ea7-2553-4aa7-882e-0f60ddb1b31b\") " pod="openshift-network-operator/iptables-alerter-nrpdh" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121623 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03c56d11-4b60-4145-9d95-4bed2230614c-ovnkube-script-lib\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121630 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp4cq\" (UniqueName: \"kubernetes.io/projected/86599ea7-2553-4aa7-882e-0f60ddb1b31b-kube-api-access-cp4cq\") pod \"iptables-alerter-nrpdh\" (UID: \"86599ea7-2553-4aa7-882e-0f60ddb1b31b\") " pod="openshift-network-operator/iptables-alerter-nrpdh" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121653 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-os-release\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121682 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-etc-kubernetes\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.124338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121683 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-os-release\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121723 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtvjg\" (UniqueName: \"kubernetes.io/projected/f4c160db-c866-4b8f-ae6d-2674197141a3-kube-api-access-wtvjg\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121746 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-os-release\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121752 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh4m2\" (UniqueName: \"kubernetes.io/projected/330e39e4-88da-45b3-a74a-e7257717a1cc-kube-api-access-mh4m2\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121777 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/266386cf-6c7a-4cba-8514-14997ab0e3b2-dbus\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121793 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-cni-netd\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121803 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03c56d11-4b60-4145-9d95-4bed2230614c-ovnkube-config\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121830 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86599ea7-2553-4aa7-882e-0f60ddb1b31b-iptables-alerter-script\") pod \"iptables-alerter-nrpdh\" (UID: \"86599ea7-2553-4aa7-882e-0f60ddb1b31b\") " pod="openshift-network-operator/iptables-alerter-nrpdh" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-system-cni-dir\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/330e39e4-88da-45b3-a74a-e7257717a1cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121900 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/266386cf-6c7a-4cba-8514-14997ab0e3b2-kubelet-config\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-run-netns\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121952 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121990 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-run-k8s-cni-cncf-io\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/330e39e4-88da-45b3-a74a-e7257717a1cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122062 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-socket-dir-parent\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122070 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/330e39e4-88da-45b3-a74a-e7257717a1cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.125163 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122103 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-os-release\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122124 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-kubelet\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.121308 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-var-lib-cni-multus\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122142 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-socket-dir-parent\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122181 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-cni-bin\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122189 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122218 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/330e39e4-88da-45b3-a74a-e7257717a1cc-system-cni-dir\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122229 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-var-lib-cni-bin\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122035 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86599ea7-2553-4aa7-882e-0f60ddb1b31b-host-slash\") pod \"iptables-alerter-nrpdh\" (UID: \"86599ea7-2553-4aa7-882e-0f60ddb1b31b\") " pod="openshift-network-operator/iptables-alerter-nrpdh" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122355 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-run-systemd\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122413 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/266386cf-6c7a-4cba-8514-14997ab0e3b2-kubelet-config\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122462 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-host-run-netns\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122502 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-host-run-k8s-cni-cncf-io\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.122543 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.122599 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret podName:266386cf-6c7a-4cba-8514-14997ab0e3b2 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:33.622581803 +0000 UTC m=+4.176424219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret") pod "global-pull-secret-syncer-qrjtq" (UID: "266386cf-6c7a-4cba-8514-14997ab0e3b2") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122637 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86599ea7-2553-4aa7-882e-0f60ddb1b31b-iptables-alerter-script\") pod \"iptables-alerter-nrpdh\" (UID: \"86599ea7-2553-4aa7-882e-0f60ddb1b31b\") " pod="openshift-network-operator/iptables-alerter-nrpdh" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122742 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f4c160db-c866-4b8f-ae6d-2674197141a3-socket-dir\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.125975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122759 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/330e39e4-88da-45b3-a74a-e7257717a1cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.126783 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122863 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-var-lib-openvswitch\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.126783 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.122921 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/330e39e4-88da-45b3-a74a-e7257717a1cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.126783 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.123112 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03c56d11-4b60-4145-9d95-4bed2230614c-node-log\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.126783 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.123166 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-system-cni-dir\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.126783 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.123318 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/266386cf-6c7a-4cba-8514-14997ab0e3b2-dbus\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:33.126783 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.123343 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44482e98-a4ab-4a66-a839-b3ef7709754e-multus-cni-dir\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.126783 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.123725 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44482e98-a4ab-4a66-a839-b3ef7709754e-cni-binary-copy\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.126783 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.123737 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03c56d11-4b60-4145-9d95-4bed2230614c-ovnkube-config\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.126783 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.123873 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03c56d11-4b60-4145-9d95-4bed2230614c-ovn-node-metrics-cert\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.143778 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.143729 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p59g8\" (UniqueName: \"kubernetes.io/projected/03c56d11-4b60-4145-9d95-4bed2230614c-kube-api-access-p59g8\") pod \"ovnkube-node-h47wm\" (UID: \"03c56d11-4b60-4145-9d95-4bed2230614c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.146526 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.146480 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp4cq\" (UniqueName: \"kubernetes.io/projected/86599ea7-2553-4aa7-882e-0f60ddb1b31b-kube-api-access-cp4cq\") pod \"iptables-alerter-nrpdh\" (UID: \"86599ea7-2553-4aa7-882e-0f60ddb1b31b\") " pod="openshift-network-operator/iptables-alerter-nrpdh" Jul 02 16:57:33.148900 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.148871 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh4m2\" (UniqueName: \"kubernetes.io/projected/330e39e4-88da-45b3-a74a-e7257717a1cc-kube-api-access-mh4m2\") pod \"multus-additional-cni-plugins-w829v\" (UID: \"330e39e4-88da-45b3-a74a-e7257717a1cc\") " pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.150180 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.150144 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtvjg\" (UniqueName: \"kubernetes.io/projected/f4c160db-c866-4b8f-ae6d-2674197141a3-kube-api-access-wtvjg\") pod \"aws-ebs-csi-driver-node-kj8t8\" (UID: \"f4c160db-c866-4b8f-ae6d-2674197141a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.151998 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.151958 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dhzv\" (UniqueName: \"kubernetes.io/projected/44482e98-a4ab-4a66-a839-b3ef7709754e-kube-api-access-5dhzv\") pod \"multus-q8rf6\" (UID: \"44482e98-a4ab-4a66-a839-b3ef7709754e\") " pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.165254 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.165234 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82cs4" Jul 02 16:57:33.170697 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.170673 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bvvxz" Jul 02 16:57:33.177438 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.177240 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:33.182222 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:33.182191 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae654452_b41a_4ef8_9c54_b29a75d6d251.slice/crio-8d942eead2513159a49a329fa3e72fd0f58bb652aaa481b18c03b22ba5129abb WatchSource:0}: Error finding container 8d942eead2513159a49a329fa3e72fd0f58bb652aaa481b18c03b22ba5129abb: Status 404 returned error can't find the container with id 8d942eead2513159a49a329fa3e72fd0f58bb652aaa481b18c03b22ba5129abb Jul 02 16:57:33.183897 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.183622 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pdg2b" Jul 02 16:57:33.190273 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.190107 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" Jul 02 16:57:33.191493 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:33.191471 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99224f0f_3094_411d_85c2_09d94b6150b2.slice/crio-737ab8cd8b120b16b420ecdeecba4aa0c2b4739c22ad5476211193e86e2fa95e WatchSource:0}: Error finding container 737ab8cd8b120b16b420ecdeecba4aa0c2b4739c22ad5476211193e86e2fa95e: Status 404 returned error can't find the container with id 737ab8cd8b120b16b420ecdeecba4aa0c2b4739c22ad5476211193e86e2fa95e Jul 02 16:57:33.194970 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.194931 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w829v" Jul 02 16:57:33.201132 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.200983 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q8rf6" Jul 02 16:57:33.201343 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:33.201321 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb317bb03_701a_42dc_94c2_91b9150c56b2.slice/crio-e8f2cb7cc8f9bb641433dd9b63f5a9414073b58874faf5b5d569eaf232291de2 WatchSource:0}: Error finding container e8f2cb7cc8f9bb641433dd9b63f5a9414073b58874faf5b5d569eaf232291de2: Status 404 returned error can't find the container with id e8f2cb7cc8f9bb641433dd9b63f5a9414073b58874faf5b5d569eaf232291de2 Jul 02 16:57:33.203505 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:33.203470 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c160db_c866_4b8f_ae6d_2674197141a3.slice/crio-b8d3f0eab6c50d221038e8f18d116fc1f3e7c8af3be394bce17ec2ba8cb7a862 WatchSource:0}: Error finding container b8d3f0eab6c50d221038e8f18d116fc1f3e7c8af3be394bce17ec2ba8cb7a862: Status 404 returned error can't find the container with id b8d3f0eab6c50d221038e8f18d116fc1f3e7c8af3be394bce17ec2ba8cb7a862 Jul 02 16:57:33.205542 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.205519 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:33.210549 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.210532 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nrpdh" Jul 02 16:57:33.215528 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:33.215505 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330e39e4_88da_45b3_a74a_e7257717a1cc.slice/crio-6de729673d964d3d6981a3dcc8ad48a5674308649da7f36880837f445b8fea0c WatchSource:0}: Error finding container 6de729673d964d3d6981a3dcc8ad48a5674308649da7f36880837f445b8fea0c: Status 404 returned error can't find the container with id 6de729673d964d3d6981a3dcc8ad48a5674308649da7f36880837f445b8fea0c Jul 02 16:57:33.227508 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:33.227486 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c56d11_4b60_4145_9d95_4bed2230614c.slice/crio-07c36ab1b7487d420e3fd76aa2f0b88401979c1318628232a849c475aa91223f WatchSource:0}: Error finding container 07c36ab1b7487d420e3fd76aa2f0b88401979c1318628232a849c475aa91223f: Status 404 returned error can't find the container with id 07c36ab1b7487d420e3fd76aa2f0b88401979c1318628232a849c475aa91223f Jul 02 16:57:33.230441 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:57:33.230420 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86599ea7_2553_4aa7_882e_0f60ddb1b31b.slice/crio-965106cbbe077ad661be525fffb8ca6d8b8a184b8541f60c6625e1ccd78d836e WatchSource:0}: Error finding container 965106cbbe077ad661be525fffb8ca6d8b8a184b8541f60c6625e1ccd78d836e: Status 404 returned error can't find the container with id 965106cbbe077ad661be525fffb8ca6d8b8a184b8541f60c6625e1ccd78d836e Jul 02 16:57:33.525528 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.525494 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:33.525693 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.525640 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:33.525742 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.525713 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs podName:0bc791e4-fe53-4c4e-b672-e9e64c4a01f7 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:34.525694506 +0000 UTC m=+5.079536905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs") pod "network-metrics-daemon-sgz5v" (UID: "0bc791e4-fe53-4c4e-b672-e9e64c4a01f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:33.618248 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.618215 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nrpdh" event={"ID":"86599ea7-2553-4aa7-882e-0f60ddb1b31b","Type":"ContainerStarted","Data":"965106cbbe077ad661be525fffb8ca6d8b8a184b8541f60c6625e1ccd78d836e"} Jul 02 16:57:33.619354 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.619313 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" event={"ID":"f4c160db-c866-4b8f-ae6d-2674197141a3","Type":"ContainerStarted","Data":"b8d3f0eab6c50d221038e8f18d116fc1f3e7c8af3be394bce17ec2ba8cb7a862"} Jul 02 16:57:33.620323 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.620301 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r2xq2" event={"ID":"99224f0f-3094-411d-85c2-09d94b6150b2","Type":"ContainerStarted","Data":"737ab8cd8b120b16b420ecdeecba4aa0c2b4739c22ad5476211193e86e2fa95e"} Jul 02 16:57:33.621440 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.621414 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bvvxz" event={"ID":"ae654452-b41a-4ef8-9c54-b29a75d6d251","Type":"ContainerStarted","Data":"8d942eead2513159a49a329fa3e72fd0f58bb652aaa481b18c03b22ba5129abb"} Jul 02 16:57:33.622569 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.622543 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82cs4" event={"ID":"b0664f46-9e9d-458a-8b78-3ea8387ebc93","Type":"ContainerStarted","Data":"cd35d718df0bdce95bfd04b5cc13a904cf7d80683c740c218f9374eb4a4584bb"} Jul 02 16:57:33.623930 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.623902 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" event={"ID":"03c56d11-4b60-4145-9d95-4bed2230614c","Type":"ContainerStarted","Data":"07c36ab1b7487d420e3fd76aa2f0b88401979c1318628232a849c475aa91223f"} Jul 02 16:57:33.625118 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.625094 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q8rf6" event={"ID":"44482e98-a4ab-4a66-a839-b3ef7709754e","Type":"ContainerStarted","Data":"c022cd778fee34757d8276d2fc43bdb289145113a4e9608ca8afcfd22b3f7da3"} Jul 02 16:57:33.625795 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.625771 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7khb\" (UniqueName: \"kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb\") pod \"network-check-target-69vq4\" (UID: \"f280972d-5590-4286-9c11-cc896f1ec909\") " pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:33.625889 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.625854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:33.625966 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.625950 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:33.626020 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.625973 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:33.626020 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.625993 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:33.626020 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.626007 2582 projected.go:196] Error preparing data for projected volume kube-api-access-p7khb for pod openshift-network-diagnostics/network-check-target-69vq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:33.626179 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.626007 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret podName:266386cf-6c7a-4cba-8514-14997ab0e3b2 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:34.625990225 +0000 UTC m=+5.179832638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret") pod "global-pull-secret-syncer-qrjtq" (UID: "266386cf-6c7a-4cba-8514-14997ab0e3b2") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:33.626179 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:33.626075 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb podName:f280972d-5590-4286-9c11-cc896f1ec909 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:34.626047637 +0000 UTC m=+5.179890036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7khb" (UniqueName: "kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb") pod "network-check-target-69vq4" (UID: "f280972d-5590-4286-9c11-cc896f1ec909") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:33.626310 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.626261 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w829v" event={"ID":"330e39e4-88da-45b3-a74a-e7257717a1cc","Type":"ContainerStarted","Data":"6de729673d964d3d6981a3dcc8ad48a5674308649da7f36880837f445b8fea0c"} Jul 02 16:57:33.627352 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.627329 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pdg2b" event={"ID":"b317bb03-701a-42dc-94c2-91b9150c56b2","Type":"ContainerStarted","Data":"e8f2cb7cc8f9bb641433dd9b63f5a9414073b58874faf5b5d569eaf232291de2"} Jul 02 16:57:33.957235 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.957106 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:52:32 +0000 UTC" deadline="2028-03-29 08:57:38.523044968 +0000 UTC" Jul 02 16:57:33.957235 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:33.957170 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15256h0m4.565878922s" Jul 02 16:57:34.532256 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:34.532125 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:34.532460 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:34.532295 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:34.532460 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:34.532370 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs podName:0bc791e4-fe53-4c4e-b672-e9e64c4a01f7 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:36.532349747 +0000 UTC m=+7.086192166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs") pod "network-metrics-daemon-sgz5v" (UID: "0bc791e4-fe53-4c4e-b672-e9e64c4a01f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:34.612168 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:34.612132 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:34.612351 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:34.612259 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:34.612747 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:34.612724 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:34.612861 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:34.612823 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:34.612929 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:34.612900 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:34.613030 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:34.612988 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:34.633123 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:34.633094 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:34.633265 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:34.633137 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7khb\" (UniqueName: \"kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb\") pod \"network-check-target-69vq4\" (UID: \"f280972d-5590-4286-9c11-cc896f1ec909\") " pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:34.633345 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:34.633303 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:34.633345 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:34.633321 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:34.633345 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:34.633335 2582 projected.go:196] Error preparing data for projected volume kube-api-access-p7khb for pod openshift-network-diagnostics/network-check-target-69vq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:34.633493 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:34.633387 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb podName:f280972d-5590-4286-9c11-cc896f1ec909 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:36.63336893 +0000 UTC m=+7.187211344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7khb" (UniqueName: "kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb") pod "network-check-target-69vq4" (UID: "f280972d-5590-4286-9c11-cc896f1ec909") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:34.633493 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:34.633457 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:34.633611 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:34.633491 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret podName:266386cf-6c7a-4cba-8514-14997ab0e3b2 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:36.633480647 +0000 UTC m=+7.187323063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret") pod "global-pull-secret-syncer-qrjtq" (UID: "266386cf-6c7a-4cba-8514-14997ab0e3b2") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:34.957847 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:34.957762 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:52:32 +0000 UTC" deadline="2028-02-20 00:27:23.60426528 +0000 UTC" Jul 02 16:57:34.957847 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:34.957799 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14335h29m48.646470694s" Jul 02 16:57:36.551745 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:36.551159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:36.551745 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:36.551337 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:36.551745 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:36.551401 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs podName:0bc791e4-fe53-4c4e-b672-e9e64c4a01f7 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:40.551382104 +0000 UTC m=+11.105224505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs") pod "network-metrics-daemon-sgz5v" (UID: "0bc791e4-fe53-4c4e-b672-e9e64c4a01f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:36.612643 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:36.611813 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:36.612643 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:36.611950 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:36.612643 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:36.612361 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:36.612643 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:36.612457 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:36.612643 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:36.612515 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:36.612643 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:36.612608 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:36.651992 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:36.651857 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:36.651992 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:36.651917 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7khb\" (UniqueName: \"kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb\") pod \"network-check-target-69vq4\" (UID: \"f280972d-5590-4286-9c11-cc896f1ec909\") " pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:36.651992 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:36.651965 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:36.652323 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:36.652038 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret podName:266386cf-6c7a-4cba-8514-14997ab0e3b2 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:40.65201265 +0000 UTC m=+11.205855053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret") pod "global-pull-secret-syncer-qrjtq" (UID: "266386cf-6c7a-4cba-8514-14997ab0e3b2") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:36.652323 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:36.652097 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:36.652323 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:36.652121 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:36.652323 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:36.652134 2582 projected.go:196] Error preparing data for projected volume kube-api-access-p7khb for pod openshift-network-diagnostics/network-check-target-69vq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:36.652323 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:36.652181 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb podName:f280972d-5590-4286-9c11-cc896f1ec909 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:40.652165537 +0000 UTC m=+11.206007951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7khb" (UniqueName: "kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb") pod "network-check-target-69vq4" (UID: "f280972d-5590-4286-9c11-cc896f1ec909") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:38.612329 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:38.612296 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:38.612807 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:38.612438 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:38.612807 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:38.612473 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:38.612807 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:38.612554 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:38.612807 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:38.612602 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:38.612807 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:38.612668 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:40.586478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:40.586392 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:40.586907 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:40.586552 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:40.586907 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:40.586626 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs podName:0bc791e4-fe53-4c4e-b672-e9e64c4a01f7 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:48.586605091 +0000 UTC m=+19.140447496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs") pod "network-metrics-daemon-sgz5v" (UID: "0bc791e4-fe53-4c4e-b672-e9e64c4a01f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:40.613171 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:40.612433 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:40.613171 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:40.612574 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:40.613171 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:40.612931 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:40.613171 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:40.613019 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:40.613171 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:40.613067 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:40.613171 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:40.613137 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:40.687855 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:40.687651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:40.687855 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:40.687701 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7khb\" (UniqueName: \"kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb\") pod \"network-check-target-69vq4\" (UID: \"f280972d-5590-4286-9c11-cc896f1ec909\") " pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:40.687855 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:40.687846 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:40.687855 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:40.687863 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:40.688162 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:40.687881 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:40.688162 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:40.687894 2582 projected.go:196] Error preparing data for projected volume kube-api-access-p7khb for pod openshift-network-diagnostics/network-check-target-69vq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:40.688162 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:40.687924 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret podName:266386cf-6c7a-4cba-8514-14997ab0e3b2 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:48.687905992 +0000 UTC m=+19.241748390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret") pod "global-pull-secret-syncer-qrjtq" (UID: "266386cf-6c7a-4cba-8514-14997ab0e3b2") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:40.688162 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:40.687941 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb podName:f280972d-5590-4286-9c11-cc896f1ec909 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:48.687933616 +0000 UTC m=+19.241776015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7khb" (UniqueName: "kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb") pod "network-check-target-69vq4" (UID: "f280972d-5590-4286-9c11-cc896f1ec909") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:42.612634 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:42.612594 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:42.613031 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:42.612602 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:42.613031 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:42.612753 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:42.613031 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:42.612725 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:42.613031 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:42.612891 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:42.613031 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:42.613011 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:44.612942 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:44.612760 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:44.613411 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:44.612760 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:44.613411 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:44.613033 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:44.613411 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:44.612760 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:44.613411 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:44.613114 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:44.613411 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:44.613220 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:46.612088 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:46.612053 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:46.612523 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:46.612164 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:46.612523 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:46.612174 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:46.612523 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:46.612199 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:46.612523 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:46.612305 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:46.612523 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:46.612399 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:48.612148 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:48.612111 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:48.612642 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:48.612112 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:48.612642 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:48.612241 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:48.612642 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:48.612112 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:48.612642 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:48.612312 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:48.612642 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:48.612443 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:48.644346 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:48.644314 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:48.644511 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:48.644463 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:48.644567 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:48.644517 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs podName:0bc791e4-fe53-4c4e-b672-e9e64c4a01f7 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:04.644501159 +0000 UTC m=+35.198343566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs") pod "network-metrics-daemon-sgz5v" (UID: "0bc791e4-fe53-4c4e-b672-e9e64c4a01f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:48.745441 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:48.745398 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:48.745612 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:48.745452 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7khb\" (UniqueName: \"kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb\") pod \"network-check-target-69vq4\" (UID: \"f280972d-5590-4286-9c11-cc896f1ec909\") " pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:48.745612 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:48.745559 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:48.745612 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:48.745593 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:48.745612 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:48.745608 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:48.745612 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:48.745617 2582 projected.go:196] Error preparing data for projected volume kube-api-access-p7khb for pod openshift-network-diagnostics/network-check-target-69vq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:48.745830 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:48.745620 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret podName:266386cf-6c7a-4cba-8514-14997ab0e3b2 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:04.74560626 +0000 UTC m=+35.299448660 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret") pod "global-pull-secret-syncer-qrjtq" (UID: "266386cf-6c7a-4cba-8514-14997ab0e3b2") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:48.745830 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:48.745660 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb podName:f280972d-5590-4286-9c11-cc896f1ec909 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:04.745645805 +0000 UTC m=+35.299488220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7khb" (UniqueName: "kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb") pod "network-check-target-69vq4" (UID: "f280972d-5590-4286-9c11-cc896f1ec909") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:50.612545 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:50.612352 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:50.612545 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:50.612352 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:50.613034 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:50.612352 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:50.613034 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:50.612595 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:50.613034 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:50.612477 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:50.613034 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:50.612667 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:52.613300 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.612852 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:52.613300 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.612880 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:52.613300 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:52.613208 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:52.613300 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:52.613249 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:52.613300 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.612852 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:52.614172 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:52.613336 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:52.666177 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.666008 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" event={"ID":"f4c160db-c866-4b8f-ae6d-2674197141a3","Type":"ContainerStarted","Data":"91dd073bf54c5a9e512f4a0433f3a1f815cf17d99a6433ca82c96862e630b401"} Jul 02 16:57:52.667428 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.667396 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r2xq2" event={"ID":"99224f0f-3094-411d-85c2-09d94b6150b2","Type":"ContainerStarted","Data":"d150424b31cd38a9ae8e2bbdc65178db867293f2856b79ef745db8360da49a07"} Jul 02 16:57:52.669128 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.669088 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bvvxz" event={"ID":"ae654452-b41a-4ef8-9c54-b29a75d6d251","Type":"ContainerStarted","Data":"9132617b030bc423f61b8bc9b2c817dd62c92b368fd8399bf87370c11a7756be"} Jul 02 16:57:52.671002 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.670964 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82cs4" event={"ID":"b0664f46-9e9d-458a-8b78-3ea8387ebc93","Type":"ContainerStarted","Data":"e720641aed9f628700a8e93f80d0d6d6fde61fa4ca5021160bd6464a2095e27a"} Jul 02 16:57:52.672391 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.672361 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-177.ec2.internal" event={"ID":"17401ed3249bf6dca968e66b7a400752","Type":"ContainerStarted","Data":"ed3efc80ecde94846161070453a944fa4ed65315a6518c2e28e79a57e9f5dd33"} Jul 02 16:57:52.673791 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.673770 2582 generic.go:356] "Generic (PLEG): container finished" podID="f058c965328c85502b30c600a403fbe5" containerID="cb5ffcff1a6c600add2291760b4467fda13d8c180c6e4182a7f54ebdd1de4370" exitCode=0 Jul 02 16:57:52.673878 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.673815 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" event={"ID":"f058c965328c85502b30c600a403fbe5","Type":"ContainerDied","Data":"cb5ffcff1a6c600add2291760b4467fda13d8c180c6e4182a7f54ebdd1de4370"} Jul 02 16:57:52.677336 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.677242 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 16:57:52.677619 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.677603 2582 generic.go:356] "Generic (PLEG): container finished" podID="03c56d11-4b60-4145-9d95-4bed2230614c" containerID="a5320355dc81015856f05795ddc6bb3bfc2e40e4664fdd3f02af52827bf141ea" exitCode=1 Jul 02 16:57:52.677698 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.677667 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" event={"ID":"03c56d11-4b60-4145-9d95-4bed2230614c","Type":"ContainerStarted","Data":"06570b8d38c1f8a006a1e68c168aae90dfab238ea28505d00e93f661d8a0ab3f"} Jul 02 16:57:52.677749 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.677716 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" event={"ID":"03c56d11-4b60-4145-9d95-4bed2230614c","Type":"ContainerStarted","Data":"d7048d2a723f1cb536a3748e453992d4c5cb19b12fc7ce9caef528a4855588cf"} Jul 02 16:57:52.677790 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.677750 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" event={"ID":"03c56d11-4b60-4145-9d95-4bed2230614c","Type":"ContainerStarted","Data":"4c14ce0c6f557ec0cfcbe5463659fd5e24e5aa67b2eb554b853dddea8c78fe42"} Jul 02 16:57:52.677790 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.677787 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" event={"ID":"03c56d11-4b60-4145-9d95-4bed2230614c","Type":"ContainerStarted","Data":"df92e187ebd75e917f22a3bcd488e34af983cada623cdea12d634e52201574e3"} Jul 02 16:57:52.677870 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.677812 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" event={"ID":"03c56d11-4b60-4145-9d95-4bed2230614c","Type":"ContainerDied","Data":"a5320355dc81015856f05795ddc6bb3bfc2e40e4664fdd3f02af52827bf141ea"} Jul 02 16:57:52.677870 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.677856 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" event={"ID":"03c56d11-4b60-4145-9d95-4bed2230614c","Type":"ContainerStarted","Data":"dd86ced4002fe9fb99f70bb359b05bfd85cfaf8e4e6c8e1424e9e483d298b69d"} Jul 02 16:57:52.679037 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.679012 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q8rf6" event={"ID":"44482e98-a4ab-4a66-a839-b3ef7709754e","Type":"ContainerStarted","Data":"2acbfdae9fba015f0b8369fd0f1111f9b6e3a799b571babe1f8112420b87e227"} Jul 02 16:57:52.682969 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.682814 2582 generic.go:356] "Generic (PLEG): container finished" podID="330e39e4-88da-45b3-a74a-e7257717a1cc" containerID="4726ccdbc3a748f01103093c4f8d09433c62794f2ba60b6cf27a0b11d021f5dd" exitCode=0 Jul 02 16:57:52.682969 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.682846 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w829v" event={"ID":"330e39e4-88da-45b3-a74a-e7257717a1cc","Type":"ContainerDied","Data":"4726ccdbc3a748f01103093c4f8d09433c62794f2ba60b6cf27a0b11d021f5dd"} Jul 02 16:57:52.684936 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.684916 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pdg2b" event={"ID":"b317bb03-701a-42dc-94c2-91b9150c56b2","Type":"ContainerStarted","Data":"3602a5ef5c0841c6fa33eee4b3786ec2341a1559b8ef0924b52de5f921e68947"} Jul 02 16:57:52.694333 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.694269 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r2xq2" podStartSLOduration=2.887315649 podStartE2EDuration="21.694255936s" totalImagesPullingTime="18.806940287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:52.694115262 +0000 UTC m=+23.247957684" watchObservedRunningTime="2026-07-02 16:57:52.694255936 +0000 UTC m=+23.248098357" Jul 02 16:57:52.722257 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.722207 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bvvxz" podStartSLOduration=3.273620275 podStartE2EDuration="21.722191487s" totalImagesPullingTime="18.448571212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:52.722140951 +0000 UTC m=+23.275983373" watchObservedRunningTime="2026-07-02 16:57:52.722191487 +0000 UTC m=+23.276033910" Jul 02 16:57:52.761773 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.761724 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q8rf6" podStartSLOduration=2.74803783 podStartE2EDuration="21.761707064s" totalImagesPullingTime="19.013669234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:52.761334191 +0000 UTC m=+23.315176613" watchObservedRunningTime="2026-07-02 16:57:52.761707064 +0000 UTC m=+23.315549484" Jul 02 16:57:52.933560 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.933508 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-177.ec2.internal" podStartSLOduration=20.933492789 podStartE2EDuration="20.933492789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:52.878252957 +0000 UTC m=+23.432095379" watchObservedRunningTime="2026-07-02 16:57:52.933492789 +0000 UTC m=+23.487335210" Jul 02 16:57:52.941776 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.941745 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:52.942241 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.942223 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:52.965973 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.965923 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-82cs4" podStartSLOduration=3.142178997 podStartE2EDuration="21.965907463s" totalImagesPullingTime="18.823728466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:52.937623522 +0000 UTC m=+23.491465942" watchObservedRunningTime="2026-07-02 16:57:52.965907463 +0000 UTC m=+23.519749883" Jul 02 16:57:52.999987 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:52.999898 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pdg2b" podStartSLOduration=11.476978642 podStartE2EDuration="21.999887949s" totalImagesPullingTime="10.522909307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:52.966049928 +0000 UTC m=+23.519892332" watchObservedRunningTime="2026-07-02 16:57:52.999887949 +0000 UTC m=+23.553730371" Jul 02 16:57:53.689484 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:53.689399 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" event={"ID":"f058c965328c85502b30c600a403fbe5","Type":"ContainerStarted","Data":"4c334887a5afe6a267da93da70a99de6a7ce63d773d130631037c7a81c556427"} Jul 02 16:57:53.690948 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:53.690919 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nrpdh" event={"ID":"86599ea7-2553-4aa7-882e-0f60ddb1b31b","Type":"ContainerStarted","Data":"e5dfae0da94d7a41bfcb8f961652813fa690672018d30b070414cd293efe627f"} Jul 02 16:57:53.872908 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:53.872853 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nrpdh" podStartSLOduration=3.4700814700000002 podStartE2EDuration="21.872834892s" totalImagesPullingTime="18.402753422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:53.871818204 +0000 UTC m=+24.425660625" watchObservedRunningTime="2026-07-02 16:57:53.872834892 +0000 UTC m=+24.426677314" Jul 02 16:57:53.873231 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:53.873204 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-177.ec2.internal" podStartSLOduration=21.873198114 podStartE2EDuration="21.873198114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:53.764418454 +0000 UTC m=+24.318260875" watchObservedRunningTime="2026-07-02 16:57:53.873198114 +0000 UTC m=+24.427040534" Jul 02 16:57:54.020749 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:54.020727 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 16:57:54.475639 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:54.475521 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T16:57:54.020744031Z","UUID":"60e7e09f-f2be-4633-9c81-f2a5ccf1f3b2","Handler":null,"Name":"","Endpoint":""} Jul 02 16:57:54.477342 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:54.477316 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 16:57:54.477463 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:54.477356 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 16:57:54.612772 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:54.612739 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:54.612961 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:54.612851 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:54.612961 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:54.612858 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:54.612961 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:54.612891 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:54.612961 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:54.612952 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:54.613179 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:54.613013 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:54.695100 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:54.695075 2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 16:57:54.695570 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:54.695468 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" event={"ID":"f4c160db-c866-4b8f-ae6d-2674197141a3","Type":"ContainerStarted","Data":"e3e524c4b7da0e17ab3097bcde968ab10a5c00adfa26f172288a3bf6fb2c88cd"} Jul 02 16:57:55.700988 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:55.700952 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 16:57:55.701438 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:55.701377 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" event={"ID":"03c56d11-4b60-4145-9d95-4bed2230614c","Type":"ContainerStarted","Data":"aef505b579b9977480adbe7e72ecbdf478f5c91aa263bd78047f0634e2f646ca"} Jul 02 16:57:56.612442 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:56.612407 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:56.612647 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:56.612452 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:56.612647 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:56.612457 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:56.612647 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:56.612523 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:56.612784 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:56.612642 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:56.612784 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:56.612722 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:56.860720 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:56.860690 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bvvxz_ae654452-b41a-4ef8-9c54-b29a75d6d251/dns-node-resolver/0.log" Jul 02 16:57:57.709202 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:57.709051 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 16:57:57.709645 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:57.709615 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" event={"ID":"03c56d11-4b60-4145-9d95-4bed2230614c","Type":"ContainerStarted","Data":"2aff3a632c4a01e9a743f19166b8f2037ceaf89d75a9760b911dd876af328350"} Jul 02 16:57:57.709873 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:57.709856 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:57.710028 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:57.710008 2582 scope.go:117] "RemoveContainer" containerID="a5320355dc81015856f05795ddc6bb3bfc2e40e4664fdd3f02af52827bf141ea" Jul 02 16:57:57.711773 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:57.711748 2582 generic.go:356] "Generic (PLEG): container finished" podID="330e39e4-88da-45b3-a74a-e7257717a1cc" containerID="accbd7d21ff478d45a5d105b872fa96afb2975a7433fbe20a3e540132ceec07b" exitCode=0 Jul 02 16:57:57.711871 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:57.711785 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w829v" event={"ID":"330e39e4-88da-45b3-a74a-e7257717a1cc","Type":"ContainerDied","Data":"accbd7d21ff478d45a5d105b872fa96afb2975a7433fbe20a3e540132ceec07b"} Jul 02 16:57:57.714047 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:57.714022 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" event={"ID":"f4c160db-c866-4b8f-ae6d-2674197141a3","Type":"ContainerStarted","Data":"f96a61d1994c2ff712187d2283acd8f5ab455c3238c67159e856bce0ad3e4b89"} Jul 02 16:57:57.730505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:57.730488 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:57.979669 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:57.979609 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pdg2b_b317bb03-701a-42dc-94c2-91b9150c56b2/node-ca/0.log" Jul 02 16:57:58.612703 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.612531 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:58.612929 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.612595 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:58.612929 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:58.612771 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:58.612929 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.612622 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:58.612929 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:58.612852 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:58.613062 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:58.612944 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:58.666808 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.666783 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:58.719473 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.719453 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 16:57:58.719781 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.719752 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" event={"ID":"03c56d11-4b60-4145-9d95-4bed2230614c","Type":"ContainerStarted","Data":"7d25fc9601f865e13b4b0043c94bb46444d50c614798d52139005d926c7de4ff"} Jul 02 16:57:58.720225 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.720207 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:58.734796 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.734767 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:57:58.769467 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.769370 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" podStartSLOduration=7.944660383 podStartE2EDuration="26.769354219s" totalImagesPullingTime="18.824693836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:58.769067086 +0000 UTC m=+29.322909508" watchObservedRunningTime="2026-07-02 16:57:58.769354219 +0000 UTC m=+29.323196639" Jul 02 16:57:58.769639 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.769619 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kj8t8" podStartSLOduration=13.206368181 podStartE2EDuration="27.769614064s" totalImagesPullingTime="14.563245883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:57.913100123 +0000 UTC m=+28.466942554" watchObservedRunningTime="2026-07-02 16:57:58.769614064 +0000 UTC m=+29.323456484" Jul 02 16:57:58.919990 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.919897 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:58.920151 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.920019 2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 16:57:58.920561 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:58.920535 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r2xq2" Jul 02 16:57:59.478076 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:59.478043 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sgz5v"] Jul 02 16:57:59.478552 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:59.478193 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:57:59.478552 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:59.478329 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:57:59.478776 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:59.478750 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qrjtq"] Jul 02 16:57:59.478925 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:59.478848 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:57:59.478988 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:59.478924 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:57:59.479369 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:59.479346 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-69vq4"] Jul 02 16:57:59.479468 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:59.479448 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:57:59.479557 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:57:59.479537 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:57:59.723716 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:59.723682 2582 generic.go:356] "Generic (PLEG): container finished" podID="330e39e4-88da-45b3-a74a-e7257717a1cc" containerID="ab8c53464f60b83be358bfa01b3bf23c297d67853f5d4c4182cb14e1c29ea8a9" exitCode=0 Jul 02 16:57:59.723882 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:57:59.723763 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w829v" event={"ID":"330e39e4-88da-45b3-a74a-e7257717a1cc","Type":"ContainerDied","Data":"ab8c53464f60b83be358bfa01b3bf23c297d67853f5d4c4182cb14e1c29ea8a9"} Jul 02 16:58:00.612297 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:00.612242 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:00.612833 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:00.612306 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:00.612833 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:00.612390 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:00.612833 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:00.612490 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:01.613082 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:01.613051 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:01.613515 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:01.613169 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:01.730428 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:01.730389 2582 generic.go:356] "Generic (PLEG): container finished" podID="330e39e4-88da-45b3-a74a-e7257717a1cc" containerID="f807ee7a02a54a28395058967e039398b27d8ae27d44da1c54c992f8dcf063db" exitCode=0 Jul 02 16:58:01.730581 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:01.730436 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w829v" event={"ID":"330e39e4-88da-45b3-a74a-e7257717a1cc","Type":"ContainerDied","Data":"f807ee7a02a54a28395058967e039398b27d8ae27d44da1c54c992f8dcf063db"} Jul 02 16:58:02.613089 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:02.612858 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:02.613533 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:02.612904 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:02.613533 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:02.613190 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:02.613533 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:02.613316 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:03.612402 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:03.612375 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:03.612588 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:03.612515 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:04.612363 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:04.612327 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:04.612363 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:04.612355 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:04.612861 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:04.612473 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:04.612861 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:04.612606 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:04.662229 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:04.662197 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:04.662441 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:04.662353 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:58:04.662441 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:04.662422 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs podName:0bc791e4-fe53-4c4e-b672-e9e64c4a01f7 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:36.662403664 +0000 UTC m=+67.216246067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs") pod "network-metrics-daemon-sgz5v" (UID: "0bc791e4-fe53-4c4e-b672-e9e64c4a01f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:58:04.763202 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:04.763159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:04.763403 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:04.763218 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7khb\" (UniqueName: \"kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb\") pod \"network-check-target-69vq4\" (UID: \"f280972d-5590-4286-9c11-cc896f1ec909\") " pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:04.763403 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:04.763347 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:58:04.763526 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:04.763411 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:58:04.763526 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:04.763424 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret podName:266386cf-6c7a-4cba-8514-14997ab0e3b2 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:36.763405956 +0000 UTC m=+67.317248365 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret") pod "global-pull-secret-syncer-qrjtq" (UID: "266386cf-6c7a-4cba-8514-14997ab0e3b2") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:58:04.763526 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:04.763436 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:58:04.763526 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:04.763451 2582 projected.go:196] Error preparing data for projected volume kube-api-access-p7khb for pod openshift-network-diagnostics/network-check-target-69vq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:58:04.763526 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:04.763508 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb podName:f280972d-5590-4286-9c11-cc896f1ec909 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:36.763490398 +0000 UTC m=+67.317332821 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7khb" (UniqueName: "kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb") pod "network-check-target-69vq4" (UID: "f280972d-5590-4286-9c11-cc896f1ec909") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:58:05.612128 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:05.612088 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:05.612306 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:05.612230 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:06.612558 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:06.612526 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:06.612558 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:06.612545 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:06.612945 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:06.612654 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:06.612945 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:06.612761 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:06.744913 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:06.744879 2582 generic.go:356] "Generic (PLEG): container finished" podID="330e39e4-88da-45b3-a74a-e7257717a1cc" containerID="0766d610f71ec8aee5450aeb88b7d4421f4fb80d4340c391cdce29c79633d6d3" exitCode=0 Jul 02 16:58:06.745077 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:06.744924 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w829v" event={"ID":"330e39e4-88da-45b3-a74a-e7257717a1cc","Type":"ContainerDied","Data":"0766d610f71ec8aee5450aeb88b7d4421f4fb80d4340c391cdce29c79633d6d3"} Jul 02 16:58:07.612289 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:07.612258 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:07.612450 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:07.612386 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:07.750009 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:07.749975 2582 generic.go:356] "Generic (PLEG): container finished" podID="330e39e4-88da-45b3-a74a-e7257717a1cc" containerID="acf22a3c4f0bc13eec58f3ff8de1ae477b739bdb41bf9a3ba7e11745f4069ccb" exitCode=0 Jul 02 16:58:07.750376 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:07.750022 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w829v" event={"ID":"330e39e4-88da-45b3-a74a-e7257717a1cc","Type":"ContainerDied","Data":"acf22a3c4f0bc13eec58f3ff8de1ae477b739bdb41bf9a3ba7e11745f4069ccb"} Jul 02 16:58:08.612026 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:08.611987 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:08.612026 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:08.612025 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:08.612245 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:08.612112 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:08.612245 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:08.612195 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:08.754674 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:08.754643 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w829v" event={"ID":"330e39e4-88da-45b3-a74a-e7257717a1cc","Type":"ContainerStarted","Data":"1ba37ea44e03cc744be92293bb46c849e3584905f34bfc5c3ae724f1f3cbb248"} Jul 02 16:58:08.809003 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:08.808954 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w829v" podStartSLOduration=8.169886594 podStartE2EDuration="37.808939758s" totalImagesPullingTime="29.639053164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:08.808879265 +0000 UTC m=+39.362721686" watchObservedRunningTime="2026-07-02 16:58:08.808939758 +0000 UTC m=+39.362782179" Jul 02 16:58:09.612461 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:09.612424 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:09.612646 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:09.612537 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:10.612387 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:10.612356 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:10.612810 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:10.612447 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:10.612810 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:10.612501 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:10.612810 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:10.612583 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:11.612827 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:11.612790 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:11.613323 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:11.612877 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:12.611986 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:12.611952 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:12.612159 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:12.612049 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:12.612159 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:12.612106 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:12.612230 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:12.612203 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:13.612147 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:13.612113 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:13.612618 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:13.612221 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:14.612042 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:14.612009 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:14.612298 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:14.612009 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:14.612298 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:14.612113 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:14.612298 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:14.612173 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:15.612242 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:15.612213 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:15.612421 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:15.612335 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:16.612192 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:16.612154 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:16.612398 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:16.612157 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:16.612398 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:16.612275 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:16.612398 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:16.612366 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:17.612132 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:17.612103 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:17.612354 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:17.612239 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:18.612162 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:18.612122 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:18.612162 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:18.612146 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:18.612598 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:18.612243 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:18.612598 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:18.612356 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:19.611892 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:19.611859 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:19.612065 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:19.612004 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:20.612397 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:20.612366 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:20.612397 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:20.612397 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:20.612884 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:20.612466 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:20.612884 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:20.612606 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:21.613598 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:21.613566 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:21.613955 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:21.613693 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:22.612667 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:22.612627 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:22.612667 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:22.612661 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:22.612872 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:22.612740 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:22.612872 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:22.612852 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:23.612840 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:23.612794 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:23.613453 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:23.612928 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:24.612747 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:24.612713 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:24.612925 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:24.612714 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:24.612925 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:24.612821 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:24.612925 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:24.612891 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:25.611951 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:25.611922 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:25.612120 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:25.612033 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:26.611839 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:26.611799 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:26.612219 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:26.611906 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrjtq" podUID="266386cf-6c7a-4cba-8514-14997ab0e3b2" Jul 02 16:58:26.612219 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:26.611961 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:26.612219 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:26.612044 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69vq4" podUID="f280972d-5590-4286-9c11-cc896f1ec909" Jul 02 16:58:27.612828 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:27.612794 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:27.613315 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:27.612933 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgz5v" podUID="0bc791e4-fe53-4c4e-b672-e9e64c4a01f7" Jul 02 16:58:28.197775 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.197748 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-177.ec2.internal" event="NodeReady" Jul 02 16:58:28.197941 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.197857 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 16:58:28.293870 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.293838 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k4x6s"] Jul 02 16:58:28.295596 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.295581 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k4x6s" Jul 02 16:58:28.302449 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.302130 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cbpsw"] Jul 02 16:58:28.302704 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.302689 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 16:58:28.302859 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.302844 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p65nb\"" Jul 02 16:58:28.302859 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.302850 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 16:58:28.302985 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.302884 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 16:58:28.304310 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.304297 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.308423 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.308404 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 16:58:28.308423 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.308418 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 16:58:28.308743 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.308722 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 16:58:28.308840 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.308740 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4pq6p\"" Jul 02 16:58:28.308840 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.308754 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 16:58:28.322220 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.322192 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k4x6s"] Jul 02 16:58:28.322686 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.322669 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cbpsw"] Jul 02 16:58:28.379478 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.379445 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fb79t"] Jul 02 16:58:28.381483 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.381464 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.386234 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.386206 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 16:58:28.386447 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.386432 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gz8mr\"" Jul 02 16:58:28.386593 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.386576 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 16:58:28.397264 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.397241 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fb79t"] Jul 02 16:58:28.427903 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.427873 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f432707-7bc0-4595-820c-5704a313ee71-data-volume\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.428024 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.427908 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/964e9e04-1c1d-45ad-9e51-a44a556c015c-cert\") pod \"ingress-canary-k4x6s\" (UID: \"964e9e04-1c1d-45ad-9e51-a44a556c015c\") " pod="openshift-ingress-canary/ingress-canary-k4x6s" Jul 02 16:58:28.428024 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.427937 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f432707-7bc0-4595-820c-5704a313ee71-crio-socket\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.428024 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.427952 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f432707-7bc0-4595-820c-5704a313ee71-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.428024 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.428006 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-tmp-dir\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.428203 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.428039 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-metrics-tls\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.428203 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.428060 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvx45\" (UniqueName: \"kubernetes.io/projected/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-kube-api-access-xvx45\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.428203 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.428083 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w2gx\" (UniqueName: \"kubernetes.io/projected/964e9e04-1c1d-45ad-9e51-a44a556c015c-kube-api-access-2w2gx\") pod \"ingress-canary-k4x6s\" (UID: \"964e9e04-1c1d-45ad-9e51-a44a556c015c\") " pod="openshift-ingress-canary/ingress-canary-k4x6s" Jul 02 16:58:28.428203 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.428193 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f432707-7bc0-4595-820c-5704a313ee71-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.428399 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.428225 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pwff\" (UniqueName: \"kubernetes.io/projected/6f432707-7bc0-4595-820c-5704a313ee71-kube-api-access-2pwff\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.428399 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.428261 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-config-volume\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.529398 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f432707-7bc0-4595-820c-5704a313ee71-crio-socket\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.529510 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529413 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f432707-7bc0-4595-820c-5704a313ee71-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.529510 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529454 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-tmp-dir\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.529510 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529492 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-metrics-tls\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.529632 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529519 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvx45\" (UniqueName: \"kubernetes.io/projected/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-kube-api-access-xvx45\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.529632 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w2gx\" (UniqueName: \"kubernetes.io/projected/964e9e04-1c1d-45ad-9e51-a44a556c015c-kube-api-access-2w2gx\") pod \"ingress-canary-k4x6s\" (UID: \"964e9e04-1c1d-45ad-9e51-a44a556c015c\") " pod="openshift-ingress-canary/ingress-canary-k4x6s" Jul 02 16:58:28.529632 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529625 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f432707-7bc0-4595-820c-5704a313ee71-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.529776 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pwff\" (UniqueName: \"kubernetes.io/projected/6f432707-7bc0-4595-820c-5704a313ee71-kube-api-access-2pwff\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.529776 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529665 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-config-volume\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.529776 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529571 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f432707-7bc0-4595-820c-5704a313ee71-crio-socket\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.529776 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529691 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f432707-7bc0-4595-820c-5704a313ee71-data-volume\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.529776 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/964e9e04-1c1d-45ad-9e51-a44a556c015c-cert\") pod \"ingress-canary-k4x6s\" (UID: \"964e9e04-1c1d-45ad-9e51-a44a556c015c\") " pod="openshift-ingress-canary/ingress-canary-k4x6s" Jul 02 16:58:28.529995 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529810 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-tmp-dir\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.529995 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.529967 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f432707-7bc0-4595-820c-5704a313ee71-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.530078 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.530064 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f432707-7bc0-4595-820c-5704a313ee71-data-volume\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.530332 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.530304 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-config-volume\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.533615 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.533595 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/964e9e04-1c1d-45ad-9e51-a44a556c015c-cert\") pod \"ingress-canary-k4x6s\" (UID: \"964e9e04-1c1d-45ad-9e51-a44a556c015c\") " pod="openshift-ingress-canary/ingress-canary-k4x6s" Jul 02 16:58:28.533702 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.533628 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f432707-7bc0-4595-820c-5704a313ee71-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.533702 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.533628 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-metrics-tls\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.542536 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.542517 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvx45\" (UniqueName: \"kubernetes.io/projected/f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6-kube-api-access-xvx45\") pod \"dns-default-fb79t\" (UID: \"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6\") " pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.545998 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.543307 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pwff\" (UniqueName: \"kubernetes.io/projected/6f432707-7bc0-4595-820c-5704a313ee71-kube-api-access-2pwff\") pod \"insights-runtime-extractor-cbpsw\" (UID: \"6f432707-7bc0-4595-820c-5704a313ee71\") " pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.547674 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.547650 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w2gx\" (UniqueName: \"kubernetes.io/projected/964e9e04-1c1d-45ad-9e51-a44a556c015c-kube-api-access-2w2gx\") pod \"ingress-canary-k4x6s\" (UID: \"964e9e04-1c1d-45ad-9e51-a44a556c015c\") " pod="openshift-ingress-canary/ingress-canary-k4x6s" Jul 02 16:58:28.605459 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.605433 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k4x6s" Jul 02 16:58:28.612106 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.612082 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cbpsw" Jul 02 16:58:28.612215 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.612187 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:28.612401 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.612380 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:28.615032 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.615011 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 16:58:28.615613 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.615053 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 16:58:28.615613 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.615181 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 16:58:28.615613 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.615217 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nwbzf\"" Jul 02 16:58:28.689747 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.689719 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:28.772194 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.772166 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cbpsw"] Jul 02 16:58:28.775997 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:28.775963 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f432707_7bc0_4595_820c_5704a313ee71.slice/crio-82e24a3bd7af4342e6045aca2d5c6bb617e7564685da4eb84dafa1730085f36c WatchSource:0}: Error finding container 82e24a3bd7af4342e6045aca2d5c6bb617e7564685da4eb84dafa1730085f36c: Status 404 returned error can't find the container with id 82e24a3bd7af4342e6045aca2d5c6bb617e7564685da4eb84dafa1730085f36c Jul 02 16:58:28.799906 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.799792 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k4x6s"] Jul 02 16:58:28.802687 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.802659 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbpsw" event={"ID":"6f432707-7bc0-4595-820c-5704a313ee71","Type":"ContainerStarted","Data":"82e24a3bd7af4342e6045aca2d5c6bb617e7564685da4eb84dafa1730085f36c"} Jul 02 16:58:28.805053 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:28.805026 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964e9e04_1c1d_45ad_9e51_a44a556c015c.slice/crio-4f16183ddff1344fdf3fe3115f1a6d2450be31129cfbb9edf0129937cc398427 WatchSource:0}: Error finding container 4f16183ddff1344fdf3fe3115f1a6d2450be31129cfbb9edf0129937cc398427: Status 404 returned error can't find the container with id 4f16183ddff1344fdf3fe3115f1a6d2450be31129cfbb9edf0129937cc398427 Jul 02 16:58:28.833368 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:28.833336 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fb79t"] Jul 02 16:58:28.836633 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:28.836612 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7319a14_9f15_4ff3_a88a_a4ea1d2d87b6.slice/crio-d73ef3fb57fc572dc99fc7bea881d2e21135ea068d627d42de52fd7d9a521df2 WatchSource:0}: Error finding container d73ef3fb57fc572dc99fc7bea881d2e21135ea068d627d42de52fd7d9a521df2: Status 404 returned error can't find the container with id d73ef3fb57fc572dc99fc7bea881d2e21135ea068d627d42de52fd7d9a521df2 Jul 02 16:58:29.613937 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:29.613901 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:29.618834 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:29.618355 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 16:58:29.618834 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:29.618612 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xzcqc\"" Jul 02 16:58:29.807502 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:29.807462 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k4x6s" event={"ID":"964e9e04-1c1d-45ad-9e51-a44a556c015c","Type":"ContainerStarted","Data":"4f16183ddff1344fdf3fe3115f1a6d2450be31129cfbb9edf0129937cc398427"} Jul 02 16:58:29.809020 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:29.808993 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fb79t" event={"ID":"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6","Type":"ContainerStarted","Data":"d73ef3fb57fc572dc99fc7bea881d2e21135ea068d627d42de52fd7d9a521df2"} Jul 02 16:58:30.634567 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.634539 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d99bb8579-wfw6q"] Jul 02 16:58:30.648095 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.648066 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.652113 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.652048 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d99bb8579-wfw6q"] Jul 02 16:58:30.652113 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.652092 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 16:58:30.652375 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.652143 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 16:58:30.652481 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.652449 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 16:58:30.652591 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.652485 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 16:58:30.652729 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.652649 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 16:58:30.653452 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.653055 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kjbd2\"" Jul 02 16:58:30.653452 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.653074 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 16:58:30.653452 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.653171 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 16:58:30.746398 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.746015 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h47wm" Jul 02 16:58:30.750187 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.750158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-console-config\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.750357 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.750198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-serving-cert\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.750357 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.750234 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvst5\" (UniqueName: \"kubernetes.io/projected/04707b8f-a755-48da-a3ce-c17c408ea324-kube-api-access-zvst5\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.750357 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.750259 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-oauth-config\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.750357 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.750338 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-service-ca\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.750536 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.750377 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-oauth-serving-cert\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.851082 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.851049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-console-config\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.851261 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.851193 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-serving-cert\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.851356 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.851267 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvst5\" (UniqueName: \"kubernetes.io/projected/04707b8f-a755-48da-a3ce-c17c408ea324-kube-api-access-zvst5\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.851356 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.851316 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-oauth-config\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.851860 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.851616 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-service-ca\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.851860 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.851675 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-oauth-serving-cert\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.853997 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.853972 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 16:58:30.854111 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.854014 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 16:58:30.854253 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.854236 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 16:58:30.854253 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.854243 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 16:58:30.854383 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.854247 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 16:58:30.860114 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.860098 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 16:58:30.862931 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.862879 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-service-ca\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.863038 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.862931 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-oauth-serving-cert\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.863373 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.863291 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-console-config\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.864623 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.864603 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-oauth-config\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.864999 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.864984 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-serving-cert\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.871400 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.871382 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 16:58:30.883588 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.883566 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvst5\" (UniqueName: \"kubernetes.io/projected/04707b8f-a755-48da-a3ce-c17c408ea324-kube-api-access-zvst5\") pod \"console-5d99bb8579-wfw6q\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:30.964363 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.964263 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kjbd2\"" Jul 02 16:58:30.971984 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:30.971958 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:33.724897 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.724874 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-4b7kw"] Jul 02 16:58:33.726886 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.726866 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:33.731889 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.731869 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 16:58:33.731998 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.731877 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 16:58:33.732058 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.732012 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 16:58:33.732134 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.732117 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 16:58:33.732197 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.732171 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mvbsb\"" Jul 02 16:58:33.732312 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.732294 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 16:58:33.750207 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.750178 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-4b7kw"] Jul 02 16:58:33.878780 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.878117 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:33.878780 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.878169 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:33.878780 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.878218 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6spmc\" (UniqueName: \"kubernetes.io/projected/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-kube-api-access-6spmc\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:33.878780 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.878271 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:33.891960 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.891853 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d99bb8579-wfw6q"] Jul 02 16:58:33.898901 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:33.898851 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04707b8f_a755_48da_a3ce_c17c408ea324.slice/crio-7186cb8fe34df6667e7647ac47baff6eb960204b66da23c94fbf22843e20dae7 WatchSource:0}: Error finding container 7186cb8fe34df6667e7647ac47baff6eb960204b66da23c94fbf22843e20dae7: Status 404 returned error can't find the container with id 7186cb8fe34df6667e7647ac47baff6eb960204b66da23c94fbf22843e20dae7 Jul 02 16:58:33.979339 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.979220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:33.979339 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.979266 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:33.979339 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.979318 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6spmc\" (UniqueName: \"kubernetes.io/projected/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-kube-api-access-6spmc\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:33.979604 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.979352 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:33.979604 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:33.979403 2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 02 16:58:33.979604 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:33.979485 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-prometheus-operator-tls podName:e77a72b0-ae3c-4a7f-9614-bc3480217b2a nodeName:}" failed. No retries permitted until 2026-07-02 16:58:34.479464108 +0000 UTC m=+65.033306538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-4b7kw" (UID: "e77a72b0-ae3c-4a7f-9614-bc3480217b2a") : secret "prometheus-operator-tls" not found Jul 02 16:58:33.979981 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.979962 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:33.981614 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.981590 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:33.990975 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:33.990948 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6spmc\" (UniqueName: \"kubernetes.io/projected/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-kube-api-access-6spmc\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:34.484053 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.484021 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:34.486304 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.486268 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e77a72b0-ae3c-4a7f-9614-bc3480217b2a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-4b7kw\" (UID: \"e77a72b0-ae3c-4a7f-9614-bc3480217b2a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:34.637116 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.637035 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" Jul 02 16:58:34.800632 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.800590 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-4b7kw"] Jul 02 16:58:34.804772 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:34.804741 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77a72b0_ae3c_4a7f_9614_bc3480217b2a.slice/crio-0af763ac984800c88abb19ae382fc5028183e7bf7d0b2597ec7df2c94dc47b5a WatchSource:0}: Error finding container 0af763ac984800c88abb19ae382fc5028183e7bf7d0b2597ec7df2c94dc47b5a: Status 404 returned error can't find the container with id 0af763ac984800c88abb19ae382fc5028183e7bf7d0b2597ec7df2c94dc47b5a Jul 02 16:58:34.825479 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.825448 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbpsw" event={"ID":"6f432707-7bc0-4595-820c-5704a313ee71","Type":"ContainerStarted","Data":"db531cfb91f6e16e1c6a79a6ef17f64cb8338205c498e43718cc294924a7fa6f"} Jul 02 16:58:34.825589 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.825518 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbpsw" event={"ID":"6f432707-7bc0-4595-820c-5704a313ee71","Type":"ContainerStarted","Data":"b585a5c267163a206766aceae5a31bc678a93b9c0de95d0e7f45f466a47ce4be"} Jul 02 16:58:34.826915 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.826889 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" event={"ID":"e77a72b0-ae3c-4a7f-9614-bc3480217b2a","Type":"ContainerStarted","Data":"0af763ac984800c88abb19ae382fc5028183e7bf7d0b2597ec7df2c94dc47b5a"} Jul 02 16:58:34.828832 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.828803 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k4x6s" event={"ID":"964e9e04-1c1d-45ad-9e51-a44a556c015c","Type":"ContainerStarted","Data":"961eefb6267742059276d79b549c71902657f4ff4fc2dcabdcf4695e200e3234"} Jul 02 16:58:34.830639 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.830616 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d99bb8579-wfw6q" event={"ID":"04707b8f-a755-48da-a3ce-c17c408ea324","Type":"ContainerStarted","Data":"7186cb8fe34df6667e7647ac47baff6eb960204b66da23c94fbf22843e20dae7"} Jul 02 16:58:34.832605 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.832581 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fb79t" event={"ID":"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6","Type":"ContainerStarted","Data":"78a7bc6fc86b82889bb98c8810b96833d9d8b30d36c5e6ab3a1b6f9f44fdba5e"} Jul 02 16:58:34.832700 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.832624 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fb79t" event={"ID":"f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6","Type":"ContainerStarted","Data":"812684b2401c8bcd70807f5d4b980a72e79abb269b074ea5f0eccedfdb483d38"} Jul 02 16:58:34.832770 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.832750 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:34.865027 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:34.864974 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k4x6s" podStartSLOduration=1.953850198 podStartE2EDuration="6.864952803s" totalImagesPullingTime="4.911102605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:34.864704754 +0000 UTC m=+65.418547176" watchObservedRunningTime="2026-07-02 16:58:34.864952803 +0000 UTC m=+65.418795225" Jul 02 16:58:36.703422 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.703384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:36.710702 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.710679 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 16:58:36.715950 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.715924 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc791e4-fe53-4c4e-b672-e9e64c4a01f7-metrics-certs\") pod \"network-metrics-daemon-sgz5v\" (UID: \"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7\") " pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:36.804583 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.804541 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:36.804763 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.804592 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7khb\" (UniqueName: \"kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb\") pod \"network-check-target-69vq4\" (UID: \"f280972d-5590-4286-9c11-cc896f1ec909\") " pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:36.808360 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.808337 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 16:58:36.808471 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.808418 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 16:58:36.817555 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.817530 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/266386cf-6c7a-4cba-8514-14997ab0e3b2-original-pull-secret\") pod \"global-pull-secret-syncer-qrjtq\" (UID: \"266386cf-6c7a-4cba-8514-14997ab0e3b2\") " pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:36.818894 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.818871 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 16:58:36.828884 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.828850 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7khb\" (UniqueName: \"kubernetes.io/projected/f280972d-5590-4286-9c11-cc896f1ec909-kube-api-access-p7khb\") pod \"network-check-target-69vq4\" (UID: \"f280972d-5590-4286-9c11-cc896f1ec909\") " pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:36.832649 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.832627 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xzcqc\"" Jul 02 16:58:36.837979 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:36.837955 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgz5v" Jul 02 16:58:37.027819 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:37.027740 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nwbzf\"" Jul 02 16:58:37.031029 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:37.031008 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrjtq" Jul 02 16:58:37.036060 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:37.036038 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:38.956466 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:38.956407 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fb79t" podStartSLOduration=6.077211236 podStartE2EDuration="10.956383384s" totalImagesPullingTime="4.879172148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:34.911089866 +0000 UTC m=+65.464932288" watchObservedRunningTime="2026-07-02 16:58:38.956383384 +0000 UTC m=+69.510225808" Jul 02 16:58:38.957385 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:38.957362 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sgz5v"] Jul 02 16:58:39.152905 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.152874 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-69vq4"] Jul 02 16:58:39.155935 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:39.155907 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf280972d_5590_4286_9c11_cc896f1ec909.slice/crio-58098d24dbaa3231382061605d8117ada3f11535a367d7def533df488d572b35 WatchSource:0}: Error finding container 58098d24dbaa3231382061605d8117ada3f11535a367d7def533df488d572b35: Status 404 returned error can't find the container with id 58098d24dbaa3231382061605d8117ada3f11535a367d7def533df488d572b35 Jul 02 16:58:39.165518 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.165490 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qrjtq"] Jul 02 16:58:39.169340 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:39.169314 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266386cf_6c7a_4cba_8514_14997ab0e3b2.slice/crio-76309726bc14120e7bf43065bead78e24f34c2d9a75bcb4a8e51a2aa55584e4a WatchSource:0}: Error finding container 76309726bc14120e7bf43065bead78e24f34c2d9a75bcb4a8e51a2aa55584e4a: Status 404 returned error can't find the container with id 76309726bc14120e7bf43065bead78e24f34c2d9a75bcb4a8e51a2aa55584e4a Jul 02 16:58:39.434024 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.433938 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b75b5fd85-tff8l"] Jul 02 16:58:39.436120 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.436099 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.465427 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.465402 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 16:58:39.479895 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.479851 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b75b5fd85-tff8l"] Jul 02 16:58:39.525021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.524967 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-oauth-config\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.525021 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.525020 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-config\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.525350 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.525082 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-oauth-serving-cert\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.525350 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.525131 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-service-ca\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.525350 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.525169 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-trusted-ca-bundle\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.525350 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.525251 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-serving-cert\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.525350 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.525321 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv9w9\" (UniqueName: \"kubernetes.io/projected/3e3040e9-76d8-47c4-ac24-178b74509e1d-kube-api-access-vv9w9\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.626318 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.626232 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-serving-cert\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.626505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.626352 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv9w9\" (UniqueName: \"kubernetes.io/projected/3e3040e9-76d8-47c4-ac24-178b74509e1d-kube-api-access-vv9w9\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.626505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.626435 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-oauth-config\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.626505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.626463 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-config\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.626505 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.626497 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-oauth-serving-cert\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.626724 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.626522 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-service-ca\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.626776 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.626756 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-trusted-ca-bundle\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.627229 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.627204 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-service-ca\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.627377 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.627322 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-oauth-serving-cert\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.627438 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.627400 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-config\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.627766 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.627743 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-trusted-ca-bundle\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.629640 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.629597 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-serving-cert\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.629640 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.629632 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-oauth-config\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.638788 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.638765 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv9w9\" (UniqueName: \"kubernetes.io/projected/3e3040e9-76d8-47c4-ac24-178b74509e1d-kube-api-access-vv9w9\") pod \"console-6b75b5fd85-tff8l\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.747008 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.746870 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:39.856420 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.856305 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qrjtq" event={"ID":"266386cf-6c7a-4cba-8514-14997ab0e3b2","Type":"ContainerStarted","Data":"76309726bc14120e7bf43065bead78e24f34c2d9a75bcb4a8e51a2aa55584e4a"} Jul 02 16:58:39.863993 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.863957 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbpsw" event={"ID":"6f432707-7bc0-4595-820c-5704a313ee71","Type":"ContainerStarted","Data":"83a01c1ffea037a9da8b4f44f4d9de1e6d1241563e9a37d1bc2b313e927150b9"} Jul 02 16:58:39.867577 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.867033 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" event={"ID":"e77a72b0-ae3c-4a7f-9614-bc3480217b2a","Type":"ContainerStarted","Data":"ce6caf9b227c86c1d7a7023ad71603682a9209efb5a8a82a1883812ef2933318"} Jul 02 16:58:39.867577 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.867081 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" event={"ID":"e77a72b0-ae3c-4a7f-9614-bc3480217b2a","Type":"ContainerStarted","Data":"7befa0daa87799d261cef8d745232b464ee6a47b20007f39fb88477450df5dff"} Jul 02 16:58:39.869081 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.869055 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sgz5v" event={"ID":"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7","Type":"ContainerStarted","Data":"f4f87f7482aa175f4a8db82cdae89366eb9b72c85f381230e6e47ca3d3206e18"} Jul 02 16:58:39.871161 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.871114 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d99bb8579-wfw6q" event={"ID":"04707b8f-a755-48da-a3ce-c17c408ea324","Type":"ContainerStarted","Data":"43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7"} Jul 02 16:58:39.873054 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.873031 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-69vq4" event={"ID":"f280972d-5590-4286-9c11-cc896f1ec909","Type":"ContainerStarted","Data":"58098d24dbaa3231382061605d8117ada3f11535a367d7def533df488d572b35"} Jul 02 16:58:39.949187 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.949131 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cbpsw" podStartSLOduration=2.10492632 podStartE2EDuration="11.949111098s" totalImagesPullingTime="9.844184778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:58:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:39.90230889 +0000 UTC m=+70.456151336" watchObservedRunningTime="2026-07-02 16:58:39.949111098 +0000 UTC m=+70.502953520" Jul 02 16:58:39.994487 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.994269 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d99bb8579-wfw6q" podStartSLOduration=5.137452175 podStartE2EDuration="9.994247533s" totalImagesPullingTime="4.856795358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:39.949428876 +0000 UTC m=+70.503271325" watchObservedRunningTime="2026-07-02 16:58:39.994247533 +0000 UTC m=+70.548089956" Jul 02 16:58:39.994932 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:39.994612 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-4b7kw" podStartSLOduration=3.043708819 podStartE2EDuration="6.99460034s" totalImagesPullingTime="3.950891521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:39.993402705 +0000 UTC m=+70.547245131" watchObservedRunningTime="2026-07-02 16:58:39.99460034 +0000 UTC m=+70.548442762" Jul 02 16:58:40.205398 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:40.205368 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b75b5fd85-tff8l"] Jul 02 16:58:40.209557 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:40.209518 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3040e9_76d8_47c4_ac24_178b74509e1d.slice/crio-97d7c70596567720ff8d4d9bd5cf6dda4560c25df5bea9acf91e949fdb128d70 WatchSource:0}: Error finding container 97d7c70596567720ff8d4d9bd5cf6dda4560c25df5bea9acf91e949fdb128d70: Status 404 returned error can't find the container with id 97d7c70596567720ff8d4d9bd5cf6dda4560c25df5bea9acf91e949fdb128d70 Jul 02 16:58:40.880517 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:40.880270 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sgz5v" event={"ID":"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7","Type":"ContainerStarted","Data":"696d7c991404e1901e91be7eae52902c93fad715845d9ebbdfedd3914c9b2b05"} Jul 02 16:58:40.880517 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:40.880359 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sgz5v" event={"ID":"0bc791e4-fe53-4c4e-b672-e9e64c4a01f7","Type":"ContainerStarted","Data":"a5dcde3aa20bf4dfb23596d2edda7e6e5b40b29cd086687ccc3b84ab6f281819"} Jul 02 16:58:40.882573 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:40.882513 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b75b5fd85-tff8l" event={"ID":"3e3040e9-76d8-47c4-ac24-178b74509e1d","Type":"ContainerStarted","Data":"1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73"} Jul 02 16:58:40.882573 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:40.882559 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b75b5fd85-tff8l" event={"ID":"3e3040e9-76d8-47c4-ac24-178b74509e1d","Type":"ContainerStarted","Data":"97d7c70596567720ff8d4d9bd5cf6dda4560c25df5bea9acf91e949fdb128d70"} Jul 02 16:58:40.961052 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:40.960990 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sgz5v" podStartSLOduration=68.867345836 podStartE2EDuration="1m9.960968046s" totalImagesPullingTime="1.09362221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:40.915266436 +0000 UTC m=+71.469108860" watchObservedRunningTime="2026-07-02 16:58:40.960968046 +0000 UTC m=+71.514810468" Jul 02 16:58:40.961377 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:40.961346 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b75b5fd85-tff8l" podStartSLOduration=1.961337183 podStartE2EDuration="1.961337183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:40.958670645 +0000 UTC m=+71.512513066" watchObservedRunningTime="2026-07-02 16:58:40.961337183 +0000 UTC m=+71.515179604" Jul 02 16:58:40.972368 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:40.972271 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:40.972368 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:40.972345 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:40.978821 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:40.978794 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:41.891349 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:41.891319 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:58:42.595950 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.595921 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j"] Jul 02 16:58:42.598093 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.598070 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.604661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.604635 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 16:58:42.607495 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.607473 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vxg7r\"" Jul 02 16:58:42.613539 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.613516 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 16:58:42.638846 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.638815 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-nbgqb"] Jul 02 16:58:42.641145 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.641127 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.644689 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.644666 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 16:58:42.644814 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.644675 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 16:58:42.669285 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.669257 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qmmh8\"" Jul 02 16:58:42.669776 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.669636 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 16:58:42.695559 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.695534 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-nbgqb"] Jul 02 16:58:42.697090 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.697069 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-krdgj"] Jul 02 16:58:42.699758 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.699721 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.703822 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.703804 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 16:58:42.704701 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.704680 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 16:58:42.704952 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.704939 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 16:58:42.709959 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.709941 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2vvhn\"" Jul 02 16:58:42.751177 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.751143 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.751395 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.751195 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dchdj\" (UniqueName: \"kubernetes.io/projected/5b70113c-87cf-47d6-b361-a52826f553ca-kube-api-access-dchdj\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.751395 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.751225 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh5q4\" (UniqueName: \"kubernetes.io/projected/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-kube-api-access-dh5q4\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.751395 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.751320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.751395 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.751356 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b70113c-87cf-47d6-b361-a52826f553ca-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.751395 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.751387 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b70113c-87cf-47d6-b361-a52826f553ca-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.751671 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.751425 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b70113c-87cf-47d6-b361-a52826f553ca-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.751671 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.751460 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b70113c-87cf-47d6-b361-a52826f553ca-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.751671 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.751493 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.751671 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.751530 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b70113c-87cf-47d6-b361-a52826f553ca-metrics-client-ca\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.774662 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.774634 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j"] Jul 02 16:58:42.852338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852233 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/247cf958-5035-4542-9716-2bd3eb23cdf0-metrics-client-ca\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.852338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852295 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b70113c-87cf-47d6-b361-a52826f553ca-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.852338 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852336 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b70113c-87cf-47d6-b361-a52826f553ca-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.852655 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852365 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.852655 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.852655 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852411 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b70113c-87cf-47d6-b361-a52826f553ca-metrics-client-ca\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.852655 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852436 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-textfile\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.852655 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852469 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.852655 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852498 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/247cf958-5035-4542-9716-2bd3eb23cdf0-sys\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.852655 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dchdj\" (UniqueName: \"kubernetes.io/projected/5b70113c-87cf-47d6-b361-a52826f553ca-kube-api-access-dchdj\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.852655 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:42.852546 2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 02 16:58:42.852655 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852559 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh5q4\" (UniqueName: \"kubernetes.io/projected/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-kube-api-access-dh5q4\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.852655 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852581 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-tls\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.852655 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:42.852610 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-openshift-state-metrics-tls podName:f6bf9097-bbf0-4b0b-ba32-8553b28f5441 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:43.352588328 +0000 UTC m=+73.906430728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-mdr6j" (UID: "f6bf9097-bbf0-4b0b-ba32-8553b28f5441") : secret "openshift-state-metrics-tls" not found Jul 02 16:58:42.853209 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852762 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/247cf958-5035-4542-9716-2bd3eb23cdf0-root\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.853209 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852793 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.853209 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852821 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgd4z\" (UniqueName: \"kubernetes.io/projected/247cf958-5035-4542-9716-2bd3eb23cdf0-kube-api-access-dgd4z\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.853209 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852860 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b70113c-87cf-47d6-b361-a52826f553ca-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.853209 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.852890 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-wtmp\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.853209 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.853116 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b70113c-87cf-47d6-b361-a52826f553ca-metrics-client-ca\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.853209 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.853116 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b70113c-87cf-47d6-b361-a52826f553ca-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.853209 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.853167 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.853209 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.853173 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b70113c-87cf-47d6-b361-a52826f553ca-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.853683 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.853342 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b70113c-87cf-47d6-b361-a52826f553ca-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.853683 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.853580 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.855441 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.855399 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.855718 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.855692 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b70113c-87cf-47d6-b361-a52826f553ca-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.855953 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.855936 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b70113c-87cf-47d6-b361-a52826f553ca-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.879830 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.879803 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh5q4\" (UniqueName: \"kubernetes.io/projected/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-kube-api-access-dh5q4\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:42.896774 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.896748 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dchdj\" (UniqueName: \"kubernetes.io/projected/5b70113c-87cf-47d6-b361-a52826f553ca-kube-api-access-dchdj\") pod \"kube-state-metrics-845b954455-nbgqb\" (UID: \"5b70113c-87cf-47d6-b361-a52826f553ca\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.951223 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.951192 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" Jul 02 16:58:42.953961 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.953935 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/247cf958-5035-4542-9716-2bd3eb23cdf0-root\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.954074 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.953976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgd4z\" (UniqueName: \"kubernetes.io/projected/247cf958-5035-4542-9716-2bd3eb23cdf0-kube-api-access-dgd4z\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.954074 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.954011 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-wtmp\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.954074 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.954017 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/247cf958-5035-4542-9716-2bd3eb23cdf0-root\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.954074 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.954035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.954074 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.954063 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/247cf958-5035-4542-9716-2bd3eb23cdf0-metrics-client-ca\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.954777 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.954131 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.954777 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.954163 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-textfile\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.954777 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.954185 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-wtmp\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.954777 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.954191 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/247cf958-5035-4542-9716-2bd3eb23cdf0-sys\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.954777 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.954235 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/247cf958-5035-4542-9716-2bd3eb23cdf0-sys\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.954777 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.954243 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-tls\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.955082 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.954909 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.955191 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.955156 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-textfile\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.955399 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.955365 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/247cf958-5035-4542-9716-2bd3eb23cdf0-metrics-client-ca\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.956749 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.956728 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:42.956961 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:42.956945 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/247cf958-5035-4542-9716-2bd3eb23cdf0-node-exporter-tls\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:43.007600 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.007569 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgd4z\" (UniqueName: \"kubernetes.io/projected/247cf958-5035-4542-9716-2bd3eb23cdf0-kube-api-access-dgd4z\") pod \"node-exporter-krdgj\" (UID: \"247cf958-5035-4542-9716-2bd3eb23cdf0\") " pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:43.010406 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.010380 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krdgj" Jul 02 16:58:43.359035 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.359001 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:43.361790 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.361766 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bf9097-bbf0-4b0b-ba32-8553b28f5441-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-mdr6j\" (UID: \"f6bf9097-bbf0-4b0b-ba32-8553b28f5441\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:43.509061 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.508978 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" Jul 02 16:58:43.640148 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:43.640046 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247cf958_5035_4542_9716_2bd3eb23cdf0.slice/crio-50b8dd8b74b8120ad12c6dabff3cca64e5c4f0e0f2a5bfb989349fb5db4c786b WatchSource:0}: Error finding container 50b8dd8b74b8120ad12c6dabff3cca64e5c4f0e0f2a5bfb989349fb5db4c786b: Status 404 returned error can't find the container with id 50b8dd8b74b8120ad12c6dabff3cca64e5c4f0e0f2a5bfb989349fb5db4c786b Jul 02 16:58:43.784679 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.784654 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 16:58:43.787300 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.787265 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.791159 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.791142 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 16:58:43.791244 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.791142 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 16:58:43.795877 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.795859 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 16:58:43.796144 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.796129 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 16:58:43.796212 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.796141 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 16:58:43.798228 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.798209 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j2lgr\"" Jul 02 16:58:43.799449 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.799324 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 16:58:43.799449 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.799366 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 16:58:43.799449 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.799367 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 16:58:43.799449 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.799408 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 16:58:43.826405 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.826374 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 16:58:43.853640 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.853561 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-nbgqb"] Jul 02 16:58:43.857713 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:43.857687 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b70113c_87cf_47d6_b361_a52826f553ca.slice/crio-5e31eedd0c330184ed202a46ef2c39e48b5ac03c738923f900476886acc22fbe WatchSource:0}: Error finding container 5e31eedd0c330184ed202a46ef2c39e48b5ac03c738923f900476886acc22fbe: Status 404 returned error can't find the container with id 5e31eedd0c330184ed202a46ef2c39e48b5ac03c738923f900476886acc22fbe Jul 02 16:58:43.863084 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863057 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863198 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863099 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863198 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863157 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863198 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863185 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863350 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863225 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863350 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863350 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863294 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863350 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863330 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsw7w\" (UniqueName: \"kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-kube-api-access-fsw7w\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863489 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863357 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863489 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863393 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-web-config\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863489 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-out\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863489 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863464 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.863621 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.863508 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.870323 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.870247 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j"] Jul 02 16:58:43.872404 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:43.872379 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6bf9097_bbf0_4b0b_ba32_8553b28f5441.slice/crio-1374fd9922318364ba6eefd3843f4d3d2990729250c162e9c6bf2557ce923b70 WatchSource:0}: Error finding container 1374fd9922318364ba6eefd3843f4d3d2990729250c162e9c6bf2557ce923b70: Status 404 returned error can't find the container with id 1374fd9922318364ba6eefd3843f4d3d2990729250c162e9c6bf2557ce923b70 Jul 02 16:58:43.896162 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.896135 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-69vq4" event={"ID":"f280972d-5590-4286-9c11-cc896f1ec909","Type":"ContainerStarted","Data":"8205a3959a14654577f9ee378cc9b66cbaeb1b1bfe5ea192ab6bdac03630ba48"} Jul 02 16:58:43.896305 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.896288 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:58:43.897397 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.897378 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" event={"ID":"f6bf9097-bbf0-4b0b-ba32-8553b28f5441","Type":"ContainerStarted","Data":"1374fd9922318364ba6eefd3843f4d3d2990729250c162e9c6bf2557ce923b70"} Jul 02 16:58:43.898471 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.898447 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" event={"ID":"5b70113c-87cf-47d6-b361-a52826f553ca","Type":"ContainerStarted","Data":"5e31eedd0c330184ed202a46ef2c39e48b5ac03c738923f900476886acc22fbe"} Jul 02 16:58:43.899748 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.899726 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qrjtq" event={"ID":"266386cf-6c7a-4cba-8514-14997ab0e3b2","Type":"ContainerStarted","Data":"dcb9ecca056521445061094853839fe67c3fe766e2555c86155bf68664dbd420"} Jul 02 16:58:43.900926 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.900909 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krdgj" event={"ID":"247cf958-5035-4542-9716-2bd3eb23cdf0","Type":"ContainerStarted","Data":"50b8dd8b74b8120ad12c6dabff3cca64e5c4f0e0f2a5bfb989349fb5db4c786b"} Jul 02 16:58:43.964015 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.963957 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964015 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.963999 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964184 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.964027 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964184 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.964061 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsw7w\" (UniqueName: \"kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-kube-api-access-fsw7w\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964184 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.964088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964184 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.964128 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-web-config\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964184 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.964156 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-out\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964418 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.964186 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964418 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.964214 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964418 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.964318 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964418 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.964344 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964418 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.964373 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.964418 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.964396 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.965784 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.965233 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.965784 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.965479 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.965784 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.965702 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.967491 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.967471 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-web-config\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.968009 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.967979 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.968101 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.968009 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.968421 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.968397 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-out\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.968727 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.968701 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.968818 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.968713 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.968877 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.968843 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.969175 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.969132 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:43.969823 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:43.969807 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:44.111657 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:44.111620 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsw7w\" (UniqueName: \"kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-kube-api-access-fsw7w\") pod \"alertmanager-main-0\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:44.148344 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:44.148234 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qrjtq" podStartSLOduration=67.665317664 podStartE2EDuration="1m12.1482155s" totalImagesPullingTime="4.482897836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:44.109155601 +0000 UTC m=+74.662998022" watchObservedRunningTime="2026-07-02 16:58:44.1482155 +0000 UTC m=+74.702057921" Jul 02 16:58:44.369520 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:44.369459 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-69vq4" podStartSLOduration=68.88792075 podStartE2EDuration="1m13.369441306s" totalImagesPullingTime="4.481520556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:44.369148165 +0000 UTC m=+74.922990587" watchObservedRunningTime="2026-07-02 16:58:44.369441306 +0000 UTC m=+74.923283727" Jul 02 16:58:44.397409 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:44.397370 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 16:58:44.652659 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:44.652510 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 16:58:44.663659 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:44.662661 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9b0aee_845c_4452_8b5c_101065ce11d6.slice/crio-b43a0ab443835627b969a1efe3681ebeb21626184f05c04ec1998cca9ba7cdda WatchSource:0}: Error finding container b43a0ab443835627b969a1efe3681ebeb21626184f05c04ec1998cca9ba7cdda: Status 404 returned error can't find the container with id b43a0ab443835627b969a1efe3681ebeb21626184f05c04ec1998cca9ba7cdda Jul 02 16:58:44.840855 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:44.840822 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fb79t" Jul 02 16:58:44.913048 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:44.912962 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerStarted","Data":"b43a0ab443835627b969a1efe3681ebeb21626184f05c04ec1998cca9ba7cdda"} Jul 02 16:58:44.916596 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:44.916556 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" event={"ID":"f6bf9097-bbf0-4b0b-ba32-8553b28f5441","Type":"ContainerStarted","Data":"bb95d4c81b24b0495e773785b5be825875a6e59f9537124eecbd2ac15c72fc75"} Jul 02 16:58:44.916744 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:44.916623 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" event={"ID":"f6bf9097-bbf0-4b0b-ba32-8553b28f5441","Type":"ContainerStarted","Data":"5941183f064d09e4adbb9a9bf077cbe4250e2c49855ca4a9e8df445b6ff54c5c"} Jul 02 16:58:44.918844 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:44.918569 2582 generic.go:356] "Generic (PLEG): container finished" podID="247cf958-5035-4542-9716-2bd3eb23cdf0" containerID="9feed94ac1d40532a770f93abf1879762e60185303b26962342407d81f59953d" exitCode=0 Jul 02 16:58:44.918844 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:44.918655 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krdgj" event={"ID":"247cf958-5035-4542-9716-2bd3eb23cdf0","Type":"ContainerDied","Data":"9feed94ac1d40532a770f93abf1879762e60185303b26962342407d81f59953d"} Jul 02 16:58:45.802877 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.802855 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d5574bdf7-xd87s"] Jul 02 16:58:45.806421 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.806398 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.818259 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.817974 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 16:58:45.818259 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.817974 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 16:58:45.818259 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.817974 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 16:58:45.818259 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.818056 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dnpencleo1r3i\"" Jul 02 16:58:45.818259 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.818238 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 16:58:45.818593 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.818262 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hz4dc\"" Jul 02 16:58:45.818593 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.818302 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 16:58:45.851780 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.851679 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d5574bdf7-xd87s"] Jul 02 16:58:45.884470 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.884445 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86qp\" (UniqueName: \"kubernetes.io/projected/4c1935c0-0618-48ff-a085-c14ddea5af3f-kube-api-access-c86qp\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.884594 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.884504 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-tls\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.884594 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.884538 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.884594 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.884582 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.884759 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.884633 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.884759 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.884688 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-grpc-tls\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.884759 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.884731 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.884877 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.884766 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c1935c0-0618-48ff-a085-c14ddea5af3f-metrics-client-ca\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.925612 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.925572 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" event={"ID":"f6bf9097-bbf0-4b0b-ba32-8553b28f5441","Type":"ContainerStarted","Data":"7787e3f825b42cd7e2ec0786a4cc77270544ca547bf366fac23ccd78252398be"} Jul 02 16:58:45.934466 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.934424 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" event={"ID":"5b70113c-87cf-47d6-b361-a52826f553ca","Type":"ContainerStarted","Data":"1cfc57f50d61f0a16f691a660096c33f0a850a1c72eb84037ce4cf4dc3b7ae4a"} Jul 02 16:58:45.934665 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.934535 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" event={"ID":"5b70113c-87cf-47d6-b361-a52826f553ca","Type":"ContainerStarted","Data":"44d48380218b7a24a7c249841b338fe1ed6061d2f4ca977ae853d5ce633e201b"} Jul 02 16:58:45.938117 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.938088 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krdgj" event={"ID":"247cf958-5035-4542-9716-2bd3eb23cdf0","Type":"ContainerStarted","Data":"5b79cd80c4824688e3a72df4e44234a3cd2b25d5142ce674d1826dbe97830634"} Jul 02 16:58:45.938221 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.938146 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krdgj" event={"ID":"247cf958-5035-4542-9716-2bd3eb23cdf0","Type":"ContainerStarted","Data":"c3569fd16ebb7d30b88e8e544c22d4a2584149f5b9f7aabe37b09580b2179ca3"} Jul 02 16:58:45.940867 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.940843 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerStarted","Data":"9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b"} Jul 02 16:58:45.972204 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.972142 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mdr6j" podStartSLOduration=2.506213364 podStartE2EDuration="3.97212615s" totalImagesPullingTime="1.465912786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:45.971570274 +0000 UTC m=+76.525412701" watchObservedRunningTime="2026-07-02 16:58:45.97212615 +0000 UTC m=+76.525968570" Jul 02 16:58:45.986327 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.986292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86qp\" (UniqueName: \"kubernetes.io/projected/4c1935c0-0618-48ff-a085-c14ddea5af3f-kube-api-access-c86qp\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.986472 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.986382 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-tls\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.986472 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.986414 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.986472 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.986464 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.986644 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.986490 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.986644 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.986515 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-grpc-tls\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.986644 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.986542 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.986644 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.986570 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c1935c0-0618-48ff-a085-c14ddea5af3f-metrics-client-ca\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.987373 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.987349 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c1935c0-0618-48ff-a085-c14ddea5af3f-metrics-client-ca\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.989642 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.989613 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.989999 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.989945 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-grpc-tls\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.989999 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.989957 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-tls\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.990149 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.990056 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.990404 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.990380 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:45.990660 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:45.990637 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c1935c0-0618-48ff-a085-c14ddea5af3f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:46.020959 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:46.020935 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86qp\" (UniqueName: \"kubernetes.io/projected/4c1935c0-0618-48ff-a085-c14ddea5af3f-kube-api-access-c86qp\") pod \"thanos-querier-6d5574bdf7-xd87s\" (UID: \"4c1935c0-0618-48ff-a085-c14ddea5af3f\") " pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:46.051415 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:46.051360 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-krdgj" podStartSLOduration=3.110442326 podStartE2EDuration="4.051338914s" totalImagesPullingTime="857.237409ms" totalInitContainerRuntime="83.659179ms" isStatefulPod=true podCreationTimestamp="2026-07-02 16:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:46.049404392 +0000 UTC m=+76.603246815" watchObservedRunningTime="2026-07-02 16:58:46.051338914 +0000 UTC m=+76.605181316" Jul 02 16:58:46.120749 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:46.120718 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:46.287096 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:46.287071 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d5574bdf7-xd87s"] Jul 02 16:58:46.289062 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:46.289000 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1935c0_0618_48ff_a085_c14ddea5af3f.slice/crio-7ea624de310cb5d6f01bf3dbdb7b43eacc0d064eebfd9ef43e5fd69b6198ce0a WatchSource:0}: Error finding container 7ea624de310cb5d6f01bf3dbdb7b43eacc0d064eebfd9ef43e5fd69b6198ce0a: Status 404 returned error can't find the container with id 7ea624de310cb5d6f01bf3dbdb7b43eacc0d064eebfd9ef43e5fd69b6198ce0a Jul 02 16:58:46.946709 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:46.946674 2582 generic.go:356] "Generic (PLEG): container finished" podID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerID="9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b" exitCode=0 Jul 02 16:58:46.947168 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:46.946771 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerDied","Data":"9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b"} Jul 02 16:58:46.948498 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:46.948467 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" event={"ID":"4c1935c0-0618-48ff-a085-c14ddea5af3f","Type":"ContainerStarted","Data":"7ea624de310cb5d6f01bf3dbdb7b43eacc0d064eebfd9ef43e5fd69b6198ce0a"} Jul 02 16:58:46.951081 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:46.951027 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" event={"ID":"5b70113c-87cf-47d6-b361-a52826f553ca","Type":"ContainerStarted","Data":"bcc4642aa7550e34d1bda36f1c537d2c74582f300299409d229f0ee876f6db55"} Jul 02 16:58:47.073165 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.073105 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-nbgqb" podStartSLOduration=3.161086547 podStartE2EDuration="5.073088333s" totalImagesPullingTime="1.912001786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:47.072366381 +0000 UTC m=+77.626208803" watchObservedRunningTime="2026-07-02 16:58:47.073088333 +0000 UTC m=+77.626930757" Jul 02 16:58:47.087708 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.087672 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b75b5fd85-tff8l"] Jul 02 16:58:47.165963 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.165929 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-8942m"] Jul 02 16:58:47.169193 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.169178 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" Jul 02 16:58:47.173736 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.173713 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xfdnw\"" Jul 02 16:58:47.173845 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.173762 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 16:58:47.185797 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.185771 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64bd68fdc8-hfghl"] Jul 02 16:58:47.189424 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.189399 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.193260 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.193233 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-8942m"] Jul 02 16:58:47.219373 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.219301 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64bd68fdc8-hfghl"] Jul 02 16:58:47.299838 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.299807 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-config\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.300063 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.299850 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7398f9d5-a1d1-4d49-9af9-ec320c6dbfec-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-8942m\" (UID: \"7398f9d5-a1d1-4d49-9af9-ec320c6dbfec\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" Jul 02 16:58:47.300063 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.299876 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgtzb\" (UniqueName: \"kubernetes.io/projected/7398f9d5-a1d1-4d49-9af9-ec320c6dbfec-kube-api-access-sgtzb\") pod \"monitoring-plugin-cd8656b8-8942m\" (UID: \"7398f9d5-a1d1-4d49-9af9-ec320c6dbfec\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" Jul 02 16:58:47.300063 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.299931 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-trusted-ca-bundle\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.300063 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.299965 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-oauth-serving-cert\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.300063 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.299996 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-service-ca\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.300063 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.300037 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-serving-cert\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.300396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.300089 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29rjk\" (UniqueName: \"kubernetes.io/projected/6087cf2e-2e2c-44f0-812c-533a42038ea2-kube-api-access-29rjk\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.300396 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.300138 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-oauth-config\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.401439 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.401402 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-config\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.401635 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.401450 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7398f9d5-a1d1-4d49-9af9-ec320c6dbfec-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-8942m\" (UID: \"7398f9d5-a1d1-4d49-9af9-ec320c6dbfec\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" Jul 02 16:58:47.401635 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.401493 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgtzb\" (UniqueName: \"kubernetes.io/projected/7398f9d5-a1d1-4d49-9af9-ec320c6dbfec-kube-api-access-sgtzb\") pod \"monitoring-plugin-cd8656b8-8942m\" (UID: \"7398f9d5-a1d1-4d49-9af9-ec320c6dbfec\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" Jul 02 16:58:47.401635 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.401525 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-trusted-ca-bundle\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.401635 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.401555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-oauth-serving-cert\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.401635 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.401606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-service-ca\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.401882 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:47.401634 2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 02 16:58:47.401882 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.401642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-serving-cert\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.401882 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:58:47.401705 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7398f9d5-a1d1-4d49-9af9-ec320c6dbfec-monitoring-plugin-cert podName:7398f9d5-a1d1-4d49-9af9-ec320c6dbfec nodeName:}" failed. No retries permitted until 2026-07-02 16:58:47.901684486 +0000 UTC m=+78.455526902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7398f9d5-a1d1-4d49-9af9-ec320c6dbfec-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-8942m" (UID: "7398f9d5-a1d1-4d49-9af9-ec320c6dbfec") : secret "monitoring-plugin-cert" not found Jul 02 16:58:47.401882 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.401748 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29rjk\" (UniqueName: \"kubernetes.io/projected/6087cf2e-2e2c-44f0-812c-533a42038ea2-kube-api-access-29rjk\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.401882 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.401792 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-oauth-config\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.402268 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.402237 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-config\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.402460 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.402442 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-oauth-serving-cert\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.402665 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.402645 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-trusted-ca-bundle\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.402700 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.402663 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-service-ca\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.404577 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.404548 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-oauth-config\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.404671 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.404658 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-serving-cert\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.434966 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.434932 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29rjk\" (UniqueName: \"kubernetes.io/projected/6087cf2e-2e2c-44f0-812c-533a42038ea2-kube-api-access-29rjk\") pod \"console-64bd68fdc8-hfghl\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.435133 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.435114 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgtzb\" (UniqueName: \"kubernetes.io/projected/7398f9d5-a1d1-4d49-9af9-ec320c6dbfec-kube-api-access-sgtzb\") pod \"monitoring-plugin-cd8656b8-8942m\" (UID: \"7398f9d5-a1d1-4d49-9af9-ec320c6dbfec\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" Jul 02 16:58:47.482384 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.482302 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85d8784766-g74gx"] Jul 02 16:58:47.491240 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.491215 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.497919 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.497895 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:47.498567 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.498267 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fkbst\"" Jul 02 16:58:47.498567 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.498351 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 16:58:47.498567 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.498363 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 16:58:47.498567 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.498487 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 16:58:47.498567 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.498512 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-e52dl1a6gcd0i\"" Jul 02 16:58:47.498864 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.498714 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 16:58:47.546240 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.546165 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85d8784766-g74gx"] Jul 02 16:58:47.603354 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.603261 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae1a1820-47eb-4771-a024-5fb22ae17437-audit-log\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.603516 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.603395 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae1a1820-47eb-4771-a024-5fb22ae17437-client-ca-bundle\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.603579 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.603557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae1a1820-47eb-4771-a024-5fb22ae17437-metrics-server-audit-profiles\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.603662 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.603642 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae1a1820-47eb-4771-a024-5fb22ae17437-secret-metrics-server-tls\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.603783 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.603727 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae1a1820-47eb-4771-a024-5fb22ae17437-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.603858 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.603797 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfp9k\" (UniqueName: \"kubernetes.io/projected/ae1a1820-47eb-4771-a024-5fb22ae17437-kube-api-access-tfp9k\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.603910 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.603858 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae1a1820-47eb-4771-a024-5fb22ae17437-secret-metrics-server-client-certs\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.704798 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.704482 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae1a1820-47eb-4771-a024-5fb22ae17437-secret-metrics-server-tls\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.704798 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.704553 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae1a1820-47eb-4771-a024-5fb22ae17437-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.704798 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.704589 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfp9k\" (UniqueName: \"kubernetes.io/projected/ae1a1820-47eb-4771-a024-5fb22ae17437-kube-api-access-tfp9k\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.704798 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.704629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae1a1820-47eb-4771-a024-5fb22ae17437-secret-metrics-server-client-certs\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.704798 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.704693 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae1a1820-47eb-4771-a024-5fb22ae17437-audit-log\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.704798 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.704718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae1a1820-47eb-4771-a024-5fb22ae17437-client-ca-bundle\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.704798 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.704795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae1a1820-47eb-4771-a024-5fb22ae17437-metrics-server-audit-profiles\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.705448 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.705424 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae1a1820-47eb-4771-a024-5fb22ae17437-audit-log\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.706146 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.706042 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae1a1820-47eb-4771-a024-5fb22ae17437-metrics-server-audit-profiles\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.706316 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.706274 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae1a1820-47eb-4771-a024-5fb22ae17437-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.707900 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.707870 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae1a1820-47eb-4771-a024-5fb22ae17437-secret-metrics-server-tls\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.708357 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.708335 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae1a1820-47eb-4771-a024-5fb22ae17437-client-ca-bundle\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.708825 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.708805 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae1a1820-47eb-4771-a024-5fb22ae17437-secret-metrics-server-client-certs\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.720615 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.720564 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfp9k\" (UniqueName: \"kubernetes.io/projected/ae1a1820-47eb-4771-a024-5fb22ae17437-kube-api-access-tfp9k\") pod \"metrics-server-85d8784766-g74gx\" (UID: \"ae1a1820-47eb-4771-a024-5fb22ae17437\") " pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.742031 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.741928 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64bd68fdc8-hfghl"] Jul 02 16:58:47.745294 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:47.745255 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6087cf2e_2e2c_44f0_812c_533a42038ea2.slice/crio-267a84697a347f3de14ee260752f443b13ed5e7b875e179e2f117c9c6a5c1949 WatchSource:0}: Error finding container 267a84697a347f3de14ee260752f443b13ed5e7b875e179e2f117c9c6a5c1949: Status 404 returned error can't find the container with id 267a84697a347f3de14ee260752f443b13ed5e7b875e179e2f117c9c6a5c1949 Jul 02 16:58:47.803124 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.803094 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:58:47.906411 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.906293 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7398f9d5-a1d1-4d49-9af9-ec320c6dbfec-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-8942m\" (UID: \"7398f9d5-a1d1-4d49-9af9-ec320c6dbfec\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" Jul 02 16:58:47.909430 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.909369 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7398f9d5-a1d1-4d49-9af9-ec320c6dbfec-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-8942m\" (UID: \"7398f9d5-a1d1-4d49-9af9-ec320c6dbfec\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" Jul 02 16:58:47.959394 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.959295 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bd68fdc8-hfghl" event={"ID":"6087cf2e-2e2c-44f0-812c-533a42038ea2","Type":"ContainerStarted","Data":"efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4"} Jul 02 16:58:47.959394 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.959364 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bd68fdc8-hfghl" event={"ID":"6087cf2e-2e2c-44f0-812c-533a42038ea2","Type":"ContainerStarted","Data":"267a84697a347f3de14ee260752f443b13ed5e7b875e179e2f117c9c6a5c1949"} Jul 02 16:58:47.973874 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:47.973849 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85d8784766-g74gx"] Jul 02 16:58:48.078412 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:48.078376 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" Jul 02 16:58:48.447473 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:48.447408 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1a1820_47eb_4771_a024_5fb22ae17437.slice/crio-71e9c5b5cf2f87e9095951962ba276b1dd01fc021aeb00182d09f8c58f8a2382 WatchSource:0}: Error finding container 71e9c5b5cf2f87e9095951962ba276b1dd01fc021aeb00182d09f8c58f8a2382: Status 404 returned error can't find the container with id 71e9c5b5cf2f87e9095951962ba276b1dd01fc021aeb00182d09f8c58f8a2382 Jul 02 16:58:48.978083 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:48.977998 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85d8784766-g74gx" event={"ID":"ae1a1820-47eb-4771-a024-5fb22ae17437","Type":"ContainerStarted","Data":"71e9c5b5cf2f87e9095951962ba276b1dd01fc021aeb00182d09f8c58f8a2382"} Jul 02 16:58:48.983005 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:48.982602 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerStarted","Data":"5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37"} Jul 02 16:58:48.987132 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:48.986180 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64bd68fdc8-hfghl" podStartSLOduration=1.986157198 podStartE2EDuration="1.986157198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:47.995183384 +0000 UTC m=+78.549025804" watchObservedRunningTime="2026-07-02 16:58:48.986157198 +0000 UTC m=+79.539999620" Jul 02 16:58:48.987132 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:48.986925 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-8942m"] Jul 02 16:58:48.990899 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:48.990814 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" event={"ID":"4c1935c0-0618-48ff-a085-c14ddea5af3f","Type":"ContainerStarted","Data":"b7ed7055ddcd5062b81105236f348ac17fec66846a691fd5e68a23d83cb171c4"} Jul 02 16:58:49.691966 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.689560 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:58:49.695497 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.695474 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.704832 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.703809 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 16:58:49.704832 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.704098 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 16:58:49.704832 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.704610 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 16:58:49.705342 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.705209 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 16:58:49.707585 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.705708 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 16:58:49.707585 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.705801 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4dzh5\"" Jul 02 16:58:49.707585 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.705708 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 16:58:49.707585 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.706041 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 16:58:49.707585 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.706582 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 16:58:49.707585 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.706772 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4guvf1gusm4pa\"" Jul 02 16:58:49.707585 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.706583 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 16:58:49.707585 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.707010 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 16:58:49.708697 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.707959 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 16:58:49.708697 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.708188 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 16:58:49.718774 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.718482 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 16:58:49.719572 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.719536 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 16:58:49.747489 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.747440 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:58:49.757115 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.757012 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:58:49.824593 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824556 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.824792 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824620 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.824792 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824655 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.824792 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824681 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.824792 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824704 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.824792 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824741 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.824792 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824776 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825086 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824823 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825086 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824869 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825086 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824897 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825086 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824920 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbzxk\" (UniqueName: \"kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-kube-api-access-cbzxk\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825086 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.824983 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825086 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.825014 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825086 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.825036 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825086 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.825060 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825489 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.825091 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825489 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.825118 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825489 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.825177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825489 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.825206 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.825489 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.825242 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926093 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926058 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926093 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926101 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926126 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbzxk\" (UniqueName: \"kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-kube-api-access-cbzxk\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926176 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926231 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926254 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926298 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926319 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926355 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926382 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926411 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926456 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926503 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926536 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926559 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926604 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.926924 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926695 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.927804 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.926722 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.927804 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.927096 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.927804 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.927201 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.927804 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.927722 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.927995 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.927833 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.932310 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.932266 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.932414 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.932323 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.933172 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.927908 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.933172 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.933000 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.934122 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.933411 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.934122 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.933496 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.934122 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.934013 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.934579 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.934554 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.935607 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.935581 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.936829 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.936793 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.937042 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.937019 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.937349 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.937329 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.937941 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.937919 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.938647 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.938610 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.939658 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.939629 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbzxk\" (UniqueName: \"kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-kube-api-access-cbzxk\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:49.941088 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:49.941049 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:50.002456 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:50.002372 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerStarted","Data":"36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a"} Jul 02 16:58:50.002876 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:50.002463 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerStarted","Data":"b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096"} Jul 02 16:58:50.002876 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:50.002501 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerStarted","Data":"1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0"} Jul 02 16:58:50.002876 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:50.002526 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerStarted","Data":"3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba"} Jul 02 16:58:50.004708 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:50.004679 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" event={"ID":"4c1935c0-0618-48ff-a085-c14ddea5af3f","Type":"ContainerStarted","Data":"bbca7a5f77d352a533f588cecf30923247c3b6736041f0f449e59272a81adb99"} Jul 02 16:58:50.004820 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:50.004757 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" event={"ID":"4c1935c0-0618-48ff-a085-c14ddea5af3f","Type":"ContainerStarted","Data":"d837f15e40ba3f08c32d78dbbe4e8ea2f03904c56b820ec567d5b811aaea1347"} Jul 02 16:58:50.005895 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:50.005867 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" event={"ID":"7398f9d5-a1d1-4d49-9af9-ec320c6dbfec","Type":"ContainerStarted","Data":"8a11b9ffaabefad191fb41baa6de66476d2f30766508c422f1a1713896e7ff87"} Jul 02 16:58:50.012192 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:50.012169 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:58:50.805818 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:50.805792 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 16:58:50.810825 ip-10-0-140-177 kubenswrapper[2582]: W0702 16:58:50.810789 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e66b6e_ffb9_4e54_b1c1_6ff03f623f91.slice/crio-d2605df67b3fcf29f5d6e3fd1e210ebf4b41c1f4baef92c192ad8d77196cf1fe WatchSource:0}: Error finding container d2605df67b3fcf29f5d6e3fd1e210ebf4b41c1f4baef92c192ad8d77196cf1fe: Status 404 returned error can't find the container with id d2605df67b3fcf29f5d6e3fd1e210ebf4b41c1f4baef92c192ad8d77196cf1fe Jul 02 16:58:51.012626 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.012588 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" event={"ID":"4c1935c0-0618-48ff-a085-c14ddea5af3f","Type":"ContainerStarted","Data":"80f02b3396080cbf0e3f268e71247d7f82641dd994d6e8a57de2776471c0fda6"} Jul 02 16:58:51.013063 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.012675 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" event={"ID":"4c1935c0-0618-48ff-a085-c14ddea5af3f","Type":"ContainerStarted","Data":"ecc2e568794b72e5b44e5172c1c72ed15d6ab161a12134dde0118eeb86d6cc7d"} Jul 02 16:58:51.013063 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.012724 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" event={"ID":"4c1935c0-0618-48ff-a085-c14ddea5af3f","Type":"ContainerStarted","Data":"c63a5c1a572c044543cc317dc54bee4dd191026be74510bc2144299f8d5f9a6b"} Jul 02 16:58:51.013063 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.012767 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:51.014319 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.014267 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85d8784766-g74gx" event={"ID":"ae1a1820-47eb-4771-a024-5fb22ae17437","Type":"ContainerStarted","Data":"935574ec527fe5550b0189c7a23bf1ed0b59f9209dc02a303fcfa6c30649da88"} Jul 02 16:58:51.017732 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.017708 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerStarted","Data":"ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75"} Jul 02 16:58:51.019325 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.019303 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" event={"ID":"7398f9d5-a1d1-4d49-9af9-ec320c6dbfec","Type":"ContainerStarted","Data":"5a2b6dfa41898ea47b0ccbad0a2ed2d33985da29b2aa5927fe34aa5fe4a78473"} Jul 02 16:58:51.019459 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.019428 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" Jul 02 16:58:51.020849 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.020829 2582 generic.go:356] "Generic (PLEG): container finished" podID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerID="976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9" exitCode=0 Jul 02 16:58:51.020938 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.020858 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerDied","Data":"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9"} Jul 02 16:58:51.020938 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.020912 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerStarted","Data":"d2605df67b3fcf29f5d6e3fd1e210ebf4b41c1f4baef92c192ad8d77196cf1fe"} Jul 02 16:58:51.025601 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.025576 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" Jul 02 16:58:51.054797 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.054748 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" podStartSLOduration=2.024010755 podStartE2EDuration="6.054730143s" totalImagesPullingTime="4.030719388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:51.053038753 +0000 UTC m=+81.606881195" watchObservedRunningTime="2026-07-02 16:58:51.054730143 +0000 UTC m=+81.608572564" Jul 02 16:58:51.250074 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.249977 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.814722553 podStartE2EDuration="8.249952485s" totalImagesPullingTime="4.406865634s" totalInitContainerRuntime="28.364298ms" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:51.20278971 +0000 UTC m=+81.756632130" watchObservedRunningTime="2026-07-02 16:58:51.249952485 +0000 UTC m=+81.803794907" Jul 02 16:58:51.252126 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.252082 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-8942m" podStartSLOduration=2.6434372010000002 podStartE2EDuration="4.252066378s" totalImagesPullingTime="1.608629177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:51.249748383 +0000 UTC m=+81.803590803" watchObservedRunningTime="2026-07-02 16:58:51.252066378 +0000 UTC m=+81.805908802" Jul 02 16:58:51.303110 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:51.302256 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85d8784766-g74gx" podStartSLOduration=2.148208539 podStartE2EDuration="4.30223622s" totalImagesPullingTime="2.154027681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:51.302069087 +0000 UTC m=+81.855911509" watchObservedRunningTime="2026-07-02 16:58:51.30223622 +0000 UTC m=+81.856078643" Jul 02 16:58:55.043215 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:55.043134 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerStarted","Data":"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2"} Jul 02 16:58:55.043582 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:55.043224 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerStarted","Data":"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75"} Jul 02 16:58:55.043582 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:55.043251 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerStarted","Data":"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb"} Jul 02 16:58:55.043582 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:55.043274 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerStarted","Data":"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415"} Jul 02 16:58:55.043582 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:55.043316 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerStarted","Data":"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b"} Jul 02 16:58:55.043582 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:55.043340 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerStarted","Data":"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932"} Jul 02 16:58:57.031705 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:57.031679 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d5574bdf7-xd87s" Jul 02 16:58:57.074513 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:57.074463 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.608180869 podStartE2EDuration="8.074444407s" totalImagesPullingTime="3.446445233s" totalInitContainerRuntime="19.818305ms" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:55.098779381 +0000 UTC m=+85.652621824" watchObservedRunningTime="2026-07-02 16:58:57.074444407 +0000 UTC m=+87.628286862" Jul 02 16:58:57.498542 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:57.498508 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:57.498718 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:57.498579 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:57.503424 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:57.503401 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:58.061776 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:58.061742 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 16:58:58.161383 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:58:58.161343 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d99bb8579-wfw6q"] Jul 02 16:59:00.012813 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:00.012781 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:07.803912 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:07.803873 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:59:07.804504 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:07.803946 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:59:12.110676 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.110603 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b75b5fd85-tff8l" podUID="3e3040e9-76d8-47c4-ac24-178b74509e1d" containerName="console" containerID="cri-o://1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73" gracePeriod=15 Jul 02 16:59:12.890515 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.890484 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:59:12.941390 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.941358 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-oauth-config\") pod \"3e3040e9-76d8-47c4-ac24-178b74509e1d\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " Jul 02 16:59:12.941390 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.941389 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv9w9\" (UniqueName: \"kubernetes.io/projected/3e3040e9-76d8-47c4-ac24-178b74509e1d-kube-api-access-vv9w9\") pod \"3e3040e9-76d8-47c4-ac24-178b74509e1d\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " Jul 02 16:59:12.941625 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.941416 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-serving-cert\") pod \"3e3040e9-76d8-47c4-ac24-178b74509e1d\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " Jul 02 16:59:12.941625 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.941461 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-trusted-ca-bundle\") pod \"3e3040e9-76d8-47c4-ac24-178b74509e1d\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " Jul 02 16:59:12.941625 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.941499 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-service-ca\") pod \"3e3040e9-76d8-47c4-ac24-178b74509e1d\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " Jul 02 16:59:12.941625 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.941533 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-oauth-serving-cert\") pod \"3e3040e9-76d8-47c4-ac24-178b74509e1d\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " Jul 02 16:59:12.941625 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.941574 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-config\") pod \"3e3040e9-76d8-47c4-ac24-178b74509e1d\" (UID: \"3e3040e9-76d8-47c4-ac24-178b74509e1d\") " Jul 02 16:59:12.942027 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.941996 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3e3040e9-76d8-47c4-ac24-178b74509e1d" (UID: "3e3040e9-76d8-47c4-ac24-178b74509e1d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:12.942027 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.942006 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3e3040e9-76d8-47c4-ac24-178b74509e1d" (UID: "3e3040e9-76d8-47c4-ac24-178b74509e1d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:12.942167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.942014 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-service-ca" (OuterVolumeSpecName: "service-ca") pod "3e3040e9-76d8-47c4-ac24-178b74509e1d" (UID: "3e3040e9-76d8-47c4-ac24-178b74509e1d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:12.942167 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.942045 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-config" (OuterVolumeSpecName: "console-config") pod "3e3040e9-76d8-47c4-ac24-178b74509e1d" (UID: "3e3040e9-76d8-47c4-ac24-178b74509e1d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:12.943840 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.943817 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3e3040e9-76d8-47c4-ac24-178b74509e1d" (UID: "3e3040e9-76d8-47c4-ac24-178b74509e1d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:12.943949 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.943874 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e3040e9-76d8-47c4-ac24-178b74509e1d-kube-api-access-vv9w9" (OuterVolumeSpecName: "kube-api-access-vv9w9") pod "3e3040e9-76d8-47c4-ac24-178b74509e1d" (UID: "3e3040e9-76d8-47c4-ac24-178b74509e1d"). InnerVolumeSpecName "kube-api-access-vv9w9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:59:12.943949 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:12.943878 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3e3040e9-76d8-47c4-ac24-178b74509e1d" (UID: "3e3040e9-76d8-47c4-ac24-178b74509e1d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:13.043162 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.043077 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-oauth-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:13.043162 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.043108 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv9w9\" (UniqueName: \"kubernetes.io/projected/3e3040e9-76d8-47c4-ac24-178b74509e1d-kube-api-access-vv9w9\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:13.043162 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.043119 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-serving-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:13.043162 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.043127 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-trusted-ca-bundle\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:13.043162 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.043136 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:13.043162 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.043147 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-oauth-serving-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:13.043162 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.043156 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e3040e9-76d8-47c4-ac24-178b74509e1d-console-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:13.122705 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.122677 2582 generic.go:356] "Generic (PLEG): container finished" podID="3e3040e9-76d8-47c4-ac24-178b74509e1d" containerID="1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73" exitCode=0 Jul 02 16:59:13.123113 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.122724 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b75b5fd85-tff8l" Jul 02 16:59:13.123113 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.122773 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b75b5fd85-tff8l" event={"ID":"3e3040e9-76d8-47c4-ac24-178b74509e1d","Type":"ContainerDied","Data":"1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73"} Jul 02 16:59:13.123113 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.122822 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b75b5fd85-tff8l" event={"ID":"3e3040e9-76d8-47c4-ac24-178b74509e1d","Type":"ContainerDied","Data":"97d7c70596567720ff8d4d9bd5cf6dda4560c25df5bea9acf91e949fdb128d70"} Jul 02 16:59:13.123113 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.122842 2582 scope.go:117] "RemoveContainer" containerID="1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73" Jul 02 16:59:13.131905 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.131889 2582 scope.go:117] "RemoveContainer" containerID="1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73" Jul 02 16:59:13.132139 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:59:13.132122 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73\": container with ID starting with 1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73 not found: ID does not exist" containerID="1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73" Jul 02 16:59:13.132192 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.132147 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73"} err="failed to get container status \"1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73\": rpc error: code = NotFound desc = could not find container \"1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73\": container with ID starting with 1636f99198e8af3564d7a36d5303e2acba0a3adffa4b577274d77a570409df73 not found: ID does not exist" Jul 02 16:59:13.143887 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.143866 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b75b5fd85-tff8l"] Jul 02 16:59:13.152661 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.152637 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b75b5fd85-tff8l"] Jul 02 16:59:13.617055 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:13.617023 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e3040e9-76d8-47c4-ac24-178b74509e1d" path="/var/lib/kubelet/pods/3e3040e9-76d8-47c4-ac24-178b74509e1d/volumes" Jul 02 16:59:14.922408 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:14.922375 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-69vq4" Jul 02 16:59:23.185966 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.185867 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d99bb8579-wfw6q" podUID="04707b8f-a755-48da-a3ce-c17c408ea324" containerName="console" containerID="cri-o://43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7" gracePeriod=15 Jul 02 16:59:23.467388 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.467341 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:59:23.554751 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.554716 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-service-ca\") pod \"04707b8f-a755-48da-a3ce-c17c408ea324\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " Jul 02 16:59:23.555120 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.555100 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-oauth-serving-cert\") pod \"04707b8f-a755-48da-a3ce-c17c408ea324\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " Jul 02 16:59:23.555310 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.555293 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-oauth-config\") pod \"04707b8f-a755-48da-a3ce-c17c408ea324\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " Jul 02 16:59:23.555627 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.555586 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-serving-cert\") pod \"04707b8f-a755-48da-a3ce-c17c408ea324\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " Jul 02 16:59:23.555717 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.555658 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvst5\" (UniqueName: \"kubernetes.io/projected/04707b8f-a755-48da-a3ce-c17c408ea324-kube-api-access-zvst5\") pod \"04707b8f-a755-48da-a3ce-c17c408ea324\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " Jul 02 16:59:23.555774 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.555714 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-console-config\") pod \"04707b8f-a755-48da-a3ce-c17c408ea324\" (UID: \"04707b8f-a755-48da-a3ce-c17c408ea324\") " Jul 02 16:59:23.555839 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.555782 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-service-ca" (OuterVolumeSpecName: "service-ca") pod "04707b8f-a755-48da-a3ce-c17c408ea324" (UID: "04707b8f-a755-48da-a3ce-c17c408ea324"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:23.556024 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.556003 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:23.556161 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.556131 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-console-config" (OuterVolumeSpecName: "console-config") pod "04707b8f-a755-48da-a3ce-c17c408ea324" (UID: "04707b8f-a755-48da-a3ce-c17c408ea324"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:23.556337 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.556210 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "04707b8f-a755-48da-a3ce-c17c408ea324" (UID: "04707b8f-a755-48da-a3ce-c17c408ea324"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:59:23.557776 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.557755 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "04707b8f-a755-48da-a3ce-c17c408ea324" (UID: "04707b8f-a755-48da-a3ce-c17c408ea324"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:23.557886 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.557789 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04707b8f-a755-48da-a3ce-c17c408ea324-kube-api-access-zvst5" (OuterVolumeSpecName: "kube-api-access-zvst5") pod "04707b8f-a755-48da-a3ce-c17c408ea324" (UID: "04707b8f-a755-48da-a3ce-c17c408ea324"). InnerVolumeSpecName "kube-api-access-zvst5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:59:23.557948 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.557912 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "04707b8f-a755-48da-a3ce-c17c408ea324" (UID: "04707b8f-a755-48da-a3ce-c17c408ea324"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:59:23.657272 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.657225 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-oauth-serving-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:23.657272 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.657274 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-oauth-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:23.657541 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.657305 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04707b8f-a755-48da-a3ce-c17c408ea324-console-serving-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:23.657541 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.657318 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvst5\" (UniqueName: \"kubernetes.io/projected/04707b8f-a755-48da-a3ce-c17c408ea324-kube-api-access-zvst5\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:23.657541 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:23.657335 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04707b8f-a755-48da-a3ce-c17c408ea324-console-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 16:59:24.182241 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:24.182203 2582 generic.go:356] "Generic (PLEG): container finished" podID="04707b8f-a755-48da-a3ce-c17c408ea324" containerID="43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7" exitCode=0 Jul 02 16:59:24.182464 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:24.182254 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d99bb8579-wfw6q" Jul 02 16:59:24.182464 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:24.182327 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d99bb8579-wfw6q" event={"ID":"04707b8f-a755-48da-a3ce-c17c408ea324","Type":"ContainerDied","Data":"43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7"} Jul 02 16:59:24.182464 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:24.182382 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d99bb8579-wfw6q" event={"ID":"04707b8f-a755-48da-a3ce-c17c408ea324","Type":"ContainerDied","Data":"7186cb8fe34df6667e7647ac47baff6eb960204b66da23c94fbf22843e20dae7"} Jul 02 16:59:24.182464 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:24.182402 2582 scope.go:117] "RemoveContainer" containerID="43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7" Jul 02 16:59:24.191840 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:24.191652 2582 scope.go:117] "RemoveContainer" containerID="43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7" Jul 02 16:59:24.192082 ip-10-0-140-177 kubenswrapper[2582]: E0702 16:59:24.191957 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7\": container with ID starting with 43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7 not found: ID does not exist" containerID="43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7" Jul 02 16:59:24.192082 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:24.191994 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7"} err="failed to get container status \"43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7\": rpc error: code = NotFound desc = could not find container \"43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7\": container with ID starting with 43ff3d2f66e49c0c0b54d21dcbe07a136e800978a7cd8bb2a8f71c0ee6a5cdb7 not found: ID does not exist" Jul 02 16:59:24.198293 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:24.198254 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d99bb8579-wfw6q"] Jul 02 16:59:24.201749 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:24.201720 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d99bb8579-wfw6q"] Jul 02 16:59:25.618007 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:25.617974 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04707b8f-a755-48da-a3ce-c17c408ea324" path="/var/lib/kubelet/pods/04707b8f-a755-48da-a3ce-c17c408ea324/volumes" Jul 02 16:59:27.808958 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:27.808931 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:59:27.812770 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:27.812745 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85d8784766-g74gx" Jul 02 16:59:50.012884 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:50.012848 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:50.031914 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:50.031885 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 16:59:50.304600 ip-10-0-140-177 kubenswrapper[2582]: I0702 16:59:50.304524 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:03.538672 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:03.538635 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 17:00:03.539206 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:03.538929 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="alertmanager" containerID="cri-o://5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37" gracePeriod=120 Jul 02 17:00:03.539206 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:03.539001 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy-metric" containerID="cri-o://36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a" gracePeriod=120 Jul 02 17:00:03.539206 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:03.539034 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="prom-label-proxy" containerID="cri-o://ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75" gracePeriod=120 Jul 02 17:00:03.539206 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:03.539098 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy" containerID="cri-o://b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096" gracePeriod=120 Jul 02 17:00:03.539206 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:03.539056 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy-web" containerID="cri-o://1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0" gracePeriod=120 Jul 02 17:00:03.539206 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:03.539068 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="config-reloader" containerID="cri-o://3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba" gracePeriod=120 Jul 02 17:00:04.344038 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.344002 2582 generic.go:356] "Generic (PLEG): container finished" podID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerID="ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75" exitCode=0 Jul 02 17:00:04.344038 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.344028 2582 generic.go:356] "Generic (PLEG): container finished" podID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerID="b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096" exitCode=0 Jul 02 17:00:04.344038 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.344034 2582 generic.go:356] "Generic (PLEG): container finished" podID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerID="3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba" exitCode=0 Jul 02 17:00:04.344038 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.344041 2582 generic.go:356] "Generic (PLEG): container finished" podID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerID="5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37" exitCode=0 Jul 02 17:00:04.344316 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.344070 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerDied","Data":"ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75"} Jul 02 17:00:04.344316 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.344124 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerDied","Data":"b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096"} Jul 02 17:00:04.344316 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.344151 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerDied","Data":"3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba"} Jul 02 17:00:04.344316 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.344175 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerDied","Data":"5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37"} Jul 02 17:00:04.799457 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.799432 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:04.920240 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920138 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-metrics-client-ca\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920240 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920171 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-volume\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920240 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920208 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920544 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920259 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-main-db\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920544 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920319 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-cluster-tls-config\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920544 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920356 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-trusted-ca-bundle\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920544 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920402 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsw7w\" (UniqueName: \"kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-kube-api-access-fsw7w\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920544 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920427 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920544 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920456 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-out\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920544 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920480 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-web-config\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920544 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920518 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-main-tls\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920544 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920546 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920974 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920588 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-tls-assets\") pod \"dc9b0aee-845c-4452-8b5c-101065ce11d6\" (UID: \"dc9b0aee-845c-4452-8b5c-101065ce11d6\") " Jul 02 17:00:04.920974 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920627 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:04.920974 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920870 2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-metrics-client-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:04.920974 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.920922 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:00:04.922395 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.922361 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:04.923508 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.923471 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:04.924145 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.924063 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-out" (OuterVolumeSpecName: "config-out") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:00:04.924145 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.924091 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:04.924145 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.924108 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:04.924145 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.924122 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-volume" (OuterVolumeSpecName: "config-volume") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:04.924441 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.924166 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-kube-api-access-fsw7w" (OuterVolumeSpecName: "kube-api-access-fsw7w") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "kube-api-access-fsw7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:00:04.924441 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.924185 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:00:04.924637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.924617 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:04.927541 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.927513 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:04.934973 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:04.934951 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-web-config" (OuterVolumeSpecName: "web-config") pod "dc9b0aee-845c-4452-8b5c-101065ce11d6" (UID: "dc9b0aee-845c-4452-8b5c-101065ce11d6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:05.021947 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.021917 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-main-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.021947 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.021941 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.021947 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.021952 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-tls-assets\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.022150 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.021960 2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-volume\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.022150 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.021969 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.022150 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.021979 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-main-db\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.022150 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.021988 2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-cluster-tls-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.022150 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.021996 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc9b0aee-845c-4452-8b5c-101065ce11d6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.022150 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.022005 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsw7w\" (UniqueName: \"kubernetes.io/projected/dc9b0aee-845c-4452-8b5c-101065ce11d6-kube-api-access-fsw7w\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.022150 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.022013 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.022150 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.022021 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc9b0aee-845c-4452-8b5c-101065ce11d6-config-out\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.022150 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.022029 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc9b0aee-845c-4452-8b5c-101065ce11d6-web-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:05.350803 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.350769 2582 generic.go:356] "Generic (PLEG): container finished" podID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerID="36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a" exitCode=0 Jul 02 17:00:05.350803 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.350794 2582 generic.go:356] "Generic (PLEG): container finished" podID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerID="1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0" exitCode=0 Jul 02 17:00:05.351002 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.350856 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.351002 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.350856 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerDied","Data":"36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a"} Jul 02 17:00:05.351002 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.350927 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerDied","Data":"1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0"} Jul 02 17:00:05.351002 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.350953 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc9b0aee-845c-4452-8b5c-101065ce11d6","Type":"ContainerDied","Data":"b43a0ab443835627b969a1efe3681ebeb21626184f05c04ec1998cca9ba7cdda"} Jul 02 17:00:05.351002 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.350979 2582 scope.go:117] "RemoveContainer" containerID="ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75" Jul 02 17:00:05.359613 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.359599 2582 scope.go:117] "RemoveContainer" containerID="36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a" Jul 02 17:00:05.366367 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.366353 2582 scope.go:117] "RemoveContainer" containerID="b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096" Jul 02 17:00:05.372717 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.372698 2582 scope.go:117] "RemoveContainer" containerID="1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0" Jul 02 17:00:05.376989 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.376963 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 17:00:05.380564 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.380544 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 17:00:05.381129 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.381116 2582 scope.go:117] "RemoveContainer" containerID="3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba" Jul 02 17:00:05.387874 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.387858 2582 scope.go:117] "RemoveContainer" containerID="5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37" Jul 02 17:00:05.394569 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.394551 2582 scope.go:117] "RemoveContainer" containerID="9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b" Jul 02 17:00:05.401442 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.401427 2582 scope.go:117] "RemoveContainer" containerID="ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75" Jul 02 17:00:05.401711 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:05.401695 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75\": container with ID starting with ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75 not found: ID does not exist" containerID="ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75" Jul 02 17:00:05.401757 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.401719 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75"} err="failed to get container status \"ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75\": rpc error: code = NotFound desc = could not find container \"ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75\": container with ID starting with ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75 not found: ID does not exist" Jul 02 17:00:05.401757 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.401735 2582 scope.go:117] "RemoveContainer" containerID="36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a" Jul 02 17:00:05.401980 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:05.401960 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a\": container with ID starting with 36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a not found: ID does not exist" containerID="36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a" Jul 02 17:00:05.402021 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.401988 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a"} err="failed to get container status \"36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a\": rpc error: code = NotFound desc = could not find container \"36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a\": container with ID starting with 36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a not found: ID does not exist" Jul 02 17:00:05.402021 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.402007 2582 scope.go:117] "RemoveContainer" containerID="b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096" Jul 02 17:00:05.402267 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:05.402248 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096\": container with ID starting with b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096 not found: ID does not exist" containerID="b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096" Jul 02 17:00:05.402368 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.402270 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096"} err="failed to get container status \"b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096\": rpc error: code = NotFound desc = could not find container \"b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096\": container with ID starting with b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096 not found: ID does not exist" Jul 02 17:00:05.402368 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.402358 2582 scope.go:117] "RemoveContainer" containerID="1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0" Jul 02 17:00:05.402569 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:05.402555 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0\": container with ID starting with 1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0 not found: ID does not exist" containerID="1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0" Jul 02 17:00:05.402611 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.402572 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0"} err="failed to get container status \"1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0\": rpc error: code = NotFound desc = could not find container \"1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0\": container with ID starting with 1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0 not found: ID does not exist" Jul 02 17:00:05.402611 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.402584 2582 scope.go:117] "RemoveContainer" containerID="3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba" Jul 02 17:00:05.402777 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:05.402763 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba\": container with ID starting with 3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba not found: ID does not exist" containerID="3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba" Jul 02 17:00:05.402816 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.402778 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba"} err="failed to get container status \"3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba\": rpc error: code = NotFound desc = could not find container \"3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba\": container with ID starting with 3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba not found: ID does not exist" Jul 02 17:00:05.402816 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.402790 2582 scope.go:117] "RemoveContainer" containerID="5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37" Jul 02 17:00:05.402995 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:05.402981 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37\": container with ID starting with 5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37 not found: ID does not exist" containerID="5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37" Jul 02 17:00:05.403047 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.402996 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37"} err="failed to get container status \"5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37\": rpc error: code = NotFound desc = could not find container \"5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37\": container with ID starting with 5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37 not found: ID does not exist" Jul 02 17:00:05.403047 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.403007 2582 scope.go:117] "RemoveContainer" containerID="9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b" Jul 02 17:00:05.403228 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:05.403214 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b\": container with ID starting with 9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b not found: ID does not exist" containerID="9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b" Jul 02 17:00:05.403296 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.403232 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b"} err="failed to get container status \"9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b\": rpc error: code = NotFound desc = could not find container \"9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b\": container with ID starting with 9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b not found: ID does not exist" Jul 02 17:00:05.403296 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.403242 2582 scope.go:117] "RemoveContainer" containerID="ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75" Jul 02 17:00:05.403469 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.403450 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75"} err="failed to get container status \"ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75\": rpc error: code = NotFound desc = could not find container \"ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75\": container with ID starting with ffebe4531fc1a516cdd81f953aff1546eca71c2ab0a559e0b4f69b7bed80bb75 not found: ID does not exist" Jul 02 17:00:05.403536 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.403469 2582 scope.go:117] "RemoveContainer" containerID="36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a" Jul 02 17:00:05.403693 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.403676 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a"} err="failed to get container status \"36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a\": rpc error: code = NotFound desc = could not find container \"36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a\": container with ID starting with 36229e56f26d0e259e9eb67ec771a4e5e8a233fc1dd597ecf2ff4fbcd8bd733a not found: ID does not exist" Jul 02 17:00:05.403736 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.403702 2582 scope.go:117] "RemoveContainer" containerID="b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096" Jul 02 17:00:05.403930 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.403912 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096"} err="failed to get container status \"b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096\": rpc error: code = NotFound desc = could not find container \"b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096\": container with ID starting with b59335bdceabe2c7f27803a35220c7920fc409b5f2054838f8af3cdb095e6096 not found: ID does not exist" Jul 02 17:00:05.403976 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.403930 2582 scope.go:117] "RemoveContainer" containerID="1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0" Jul 02 17:00:05.404149 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.404129 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0"} err="failed to get container status \"1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0\": rpc error: code = NotFound desc = could not find container \"1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0\": container with ID starting with 1f465eaa2c1ef9ff5fc33e7f020f1fc4da732703ac4e2050c02cacb69ebde3a0 not found: ID does not exist" Jul 02 17:00:05.404149 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.404148 2582 scope.go:117] "RemoveContainer" containerID="3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba" Jul 02 17:00:05.404392 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.404365 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba"} err="failed to get container status \"3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba\": rpc error: code = NotFound desc = could not find container \"3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba\": container with ID starting with 3548392b05e7f7323a2325a3099f4ce61a252b58e560683dfd8cca4dbb609dba not found: ID does not exist" Jul 02 17:00:05.404459 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.404393 2582 scope.go:117] "RemoveContainer" containerID="5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37" Jul 02 17:00:05.404611 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.404594 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37"} err="failed to get container status \"5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37\": rpc error: code = NotFound desc = could not find container \"5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37\": container with ID starting with 5f9660b1c376302c65ed5acb46ffed67f0c2dfb98b2e03a8142f42ddd413ec37 not found: ID does not exist" Jul 02 17:00:05.404665 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.404611 2582 scope.go:117] "RemoveContainer" containerID="9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b" Jul 02 17:00:05.404807 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.404794 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b"} err="failed to get container status \"9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b\": rpc error: code = NotFound desc = could not find container \"9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b\": container with ID starting with 9d046e108185ef7c0941dd716b3b1fe8f2ebcc6a9f22560759857dee5c0c4a1b not found: ID does not exist" Jul 02 17:00:05.410655 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.410636 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 17:00:05.410956 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.410943 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e3040e9-76d8-47c4-ac24-178b74509e1d" containerName="console" Jul 02 17:00:05.411005 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.410958 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e3040e9-76d8-47c4-ac24-178b74509e1d" containerName="console" Jul 02 17:00:05.411005 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.410973 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04707b8f-a755-48da-a3ce-c17c408ea324" containerName="console" Jul 02 17:00:05.411005 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.410979 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="04707b8f-a755-48da-a3ce-c17c408ea324" containerName="console" Jul 02 17:00:05.411005 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.410989 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy-metric" Jul 02 17:00:05.411005 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.410997 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy-metric" Jul 02 17:00:05.411005 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411006 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="config-reloader" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411011 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="config-reloader" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411017 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411022 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411029 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="init-config-reloader" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411034 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="init-config-reloader" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411039 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy-web" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411044 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy-web" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411054 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="prom-label-proxy" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411062 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="prom-label-proxy" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411072 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="alertmanager" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411077 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="alertmanager" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411126 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411133 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="04707b8f-a755-48da-a3ce-c17c408ea324" containerName="console" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411142 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="prom-label-proxy" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411151 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e3040e9-76d8-47c4-ac24-178b74509e1d" containerName="console" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411164 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy-web" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411174 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="config-reloader" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411180 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="alertmanager" Jul 02 17:00:05.411184 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.411186 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" containerName="kube-rbac-proxy-metric" Jul 02 17:00:05.417265 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.417249 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.419797 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.419778 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 17:00:05.419882 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.419780 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 17:00:05.419882 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.419779 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 17:00:05.419882 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.419877 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 17:00:05.420053 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.419949 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 17:00:05.420222 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.420201 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 17:00:05.420379 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.420362 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 17:00:05.420455 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.420366 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 17:00:05.420569 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.420556 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j2lgr\"" Jul 02 17:00:05.425572 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.425554 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 17:00:05.431562 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.431541 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 17:00:05.525826 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.525791 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a84e154a-54cb-44ba-b73f-ad48da3f081c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.525826 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.525829 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.526045 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.525850 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a84e154a-54cb-44ba-b73f-ad48da3f081c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.526045 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.525873 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.526045 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.525936 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.526045 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.525984 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl89l\" (UniqueName: \"kubernetes.io/projected/a84e154a-54cb-44ba-b73f-ad48da3f081c-kube-api-access-fl89l\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.526045 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.526026 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a84e154a-54cb-44ba-b73f-ad48da3f081c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.526197 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.526047 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.526197 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.526077 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a84e154a-54cb-44ba-b73f-ad48da3f081c-config-out\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.526197 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.526099 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-web-config\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.526197 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.526122 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.526197 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.526137 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84e154a-54cb-44ba-b73f-ad48da3f081c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.526197 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.526153 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.621453 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.618894 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc9b0aee-845c-4452-8b5c-101065ce11d6" path="/var/lib/kubelet/pods/dc9b0aee-845c-4452-8b5c-101065ce11d6/volumes" Jul 02 17:00:05.626921 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.626898 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a84e154a-54cb-44ba-b73f-ad48da3f081c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627017 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.626931 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627017 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.626957 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a84e154a-54cb-44ba-b73f-ad48da3f081c-config-out\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627017 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.626972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-web-config\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627017 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.626994 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627185 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.627019 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84e154a-54cb-44ba-b73f-ad48da3f081c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627185 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.627128 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627294 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.627205 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a84e154a-54cb-44ba-b73f-ad48da3f081c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627294 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.627238 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627401 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.627273 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a84e154a-54cb-44ba-b73f-ad48da3f081c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627401 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.627326 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627401 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.627354 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627401 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.627395 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl89l\" (UniqueName: \"kubernetes.io/projected/a84e154a-54cb-44ba-b73f-ad48da3f081c-kube-api-access-fl89l\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.627995 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.627965 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a84e154a-54cb-44ba-b73f-ad48da3f081c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.628093 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.628011 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a84e154a-54cb-44ba-b73f-ad48da3f081c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.628158 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.628127 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84e154a-54cb-44ba-b73f-ad48da3f081c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.630140 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.630110 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-web-config\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.630242 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.630187 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.630242 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.630207 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.630382 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.630252 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.630760 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.630737 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.630830 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.630745 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a84e154a-54cb-44ba-b73f-ad48da3f081c-config-out\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.630830 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.630798 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.631130 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.631112 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a84e154a-54cb-44ba-b73f-ad48da3f081c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.632050 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.632035 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a84e154a-54cb-44ba-b73f-ad48da3f081c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.636144 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.636122 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl89l\" (UniqueName: \"kubernetes.io/projected/a84e154a-54cb-44ba-b73f-ad48da3f081c-kube-api-access-fl89l\") pod \"alertmanager-main-0\" (UID: \"a84e154a-54cb-44ba-b73f-ad48da3f081c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.726855 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.726813 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 17:00:05.866391 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:05.866293 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 17:00:05.868570 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:00:05.868546 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84e154a_54cb_44ba_b73f_ad48da3f081c.slice/crio-a5ac75dceb8c0ca6c753fc05732ae19384999e30df774c02a37d3d3411315e74 WatchSource:0}: Error finding container a5ac75dceb8c0ca6c753fc05732ae19384999e30df774c02a37d3d3411315e74: Status 404 returned error can't find the container with id a5ac75dceb8c0ca6c753fc05732ae19384999e30df774c02a37d3d3411315e74 Jul 02 17:00:06.355983 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:06.355949 2582 generic.go:356] "Generic (PLEG): container finished" podID="a84e154a-54cb-44ba-b73f-ad48da3f081c" containerID="9c081f9286a443a81178019c5541cad58fb0dd5aee684139a7cd7d89f9614b6b" exitCode=0 Jul 02 17:00:06.356171 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:06.356033 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84e154a-54cb-44ba-b73f-ad48da3f081c","Type":"ContainerDied","Data":"9c081f9286a443a81178019c5541cad58fb0dd5aee684139a7cd7d89f9614b6b"} Jul 02 17:00:06.356171 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:06.356117 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84e154a-54cb-44ba-b73f-ad48da3f081c","Type":"ContainerStarted","Data":"a5ac75dceb8c0ca6c753fc05732ae19384999e30df774c02a37d3d3411315e74"} Jul 02 17:00:07.364478 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.364446 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84e154a-54cb-44ba-b73f-ad48da3f081c","Type":"ContainerStarted","Data":"4abcfe9fd9378def1b0c20fba8c69cc932d5d47d6f93ac559c9850fa7686a9cc"} Jul 02 17:00:07.364883 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.364509 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84e154a-54cb-44ba-b73f-ad48da3f081c","Type":"ContainerStarted","Data":"30480886a28594eada2f6bb09e0117f688075ab6348486f8ecbdb152e2fd23b5"} Jul 02 17:00:07.364883 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.364535 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84e154a-54cb-44ba-b73f-ad48da3f081c","Type":"ContainerStarted","Data":"f4a7a0fff978b0c4bf519b903f929277317389e98d38e6413e8626c7d2818795"} Jul 02 17:00:07.364883 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.364560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84e154a-54cb-44ba-b73f-ad48da3f081c","Type":"ContainerStarted","Data":"1ff2cff28f4a820445811a51eea4f0d85c133fe313635eed28010f06e55945b5"} Jul 02 17:00:07.364883 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.364585 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84e154a-54cb-44ba-b73f-ad48da3f081c","Type":"ContainerStarted","Data":"e03af177a2b1086356dfdcbf6070370bec8087ef374dd81e90ac707924d3ea8e"} Jul 02 17:00:07.364883 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.364610 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84e154a-54cb-44ba-b73f-ad48da3f081c","Type":"ContainerStarted","Data":"6dfeac0380350b7d89b863860c6777dbad1fa94e95380bcf3acb02b83e277838"} Jul 02 17:00:07.401765 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.401700 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.386527389 podStartE2EDuration="2.401679878s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.152489ms" isStatefulPod=false podCreationTimestamp="2026-07-02 17:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:00:07.398683608 +0000 UTC m=+157.952526038" watchObservedRunningTime="2026-07-02 17:00:07.401679878 +0000 UTC m=+157.955522298" Jul 02 17:00:07.574454 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.574418 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-646549dcf4-88tvv"] Jul 02 17:00:07.578010 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.577985 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.580762 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.580732 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 17:00:07.581534 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.581266 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 17:00:07.581534 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.581314 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 17:00:07.581730 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.581565 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 17:00:07.582555 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.582232 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6wx56\"" Jul 02 17:00:07.582555 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.582336 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 17:00:07.591016 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.590990 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 17:00:07.597869 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.597842 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-646549dcf4-88tvv"] Jul 02 17:00:07.645612 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.645526 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-secret-telemeter-client\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.645612 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.645564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm96n\" (UniqueName: \"kubernetes.io/projected/1c09c50d-3596-45c7-b7ae-62183bcbf470-kube-api-access-tm96n\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.645792 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.645637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-federate-client-tls\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.645792 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.645701 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c09c50d-3596-45c7-b7ae-62183bcbf470-metrics-client-ca\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.645792 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.645737 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c09c50d-3596-45c7-b7ae-62183bcbf470-telemeter-trusted-ca-bundle\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.645792 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.645784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-telemeter-client-tls\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.645915 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.645808 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.645915 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.645882 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c09c50d-3596-45c7-b7ae-62183bcbf470-serving-certs-ca-bundle\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.747247 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.747206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-telemeter-client-tls\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.747532 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.747509 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.747711 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.747693 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c09c50d-3596-45c7-b7ae-62183bcbf470-serving-certs-ca-bundle\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.747868 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.747841 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-secret-telemeter-client\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.747984 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.747883 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm96n\" (UniqueName: \"kubernetes.io/projected/1c09c50d-3596-45c7-b7ae-62183bcbf470-kube-api-access-tm96n\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.747984 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.747924 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-federate-client-tls\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.747984 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.747951 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c09c50d-3596-45c7-b7ae-62183bcbf470-metrics-client-ca\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.748202 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.747989 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c09c50d-3596-45c7-b7ae-62183bcbf470-telemeter-trusted-ca-bundle\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.748879 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.748856 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c09c50d-3596-45c7-b7ae-62183bcbf470-telemeter-trusted-ca-bundle\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.749087 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.749066 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c09c50d-3596-45c7-b7ae-62183bcbf470-serving-certs-ca-bundle\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.749248 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.749224 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c09c50d-3596-45c7-b7ae-62183bcbf470-metrics-client-ca\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.750192 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.750168 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-telemeter-client-tls\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.750582 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.750562 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.750977 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.750958 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-secret-telemeter-client\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.751710 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.751682 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1c09c50d-3596-45c7-b7ae-62183bcbf470-federate-client-tls\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.759008 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.758984 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm96n\" (UniqueName: \"kubernetes.io/projected/1c09c50d-3596-45c7-b7ae-62183bcbf470-kube-api-access-tm96n\") pod \"telemeter-client-646549dcf4-88tvv\" (UID: \"1c09c50d-3596-45c7-b7ae-62183bcbf470\") " pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.894881 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.894842 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" Jul 02 17:00:07.902885 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.902856 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 17:00:07.903716 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.903248 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="prometheus" containerID="cri-o://c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932" gracePeriod=600 Jul 02 17:00:07.903716 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.903288 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy-web" containerID="cri-o://33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb" gracePeriod=600 Jul 02 17:00:07.903716 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.903426 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2" gracePeriod=600 Jul 02 17:00:07.903716 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.903435 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy" containerID="cri-o://83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75" gracePeriod=600 Jul 02 17:00:07.903716 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.903461 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="thanos-sidecar" containerID="cri-o://5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415" gracePeriod=600 Jul 02 17:00:07.903716 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:07.903524 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="config-reloader" containerID="cri-o://cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b" gracePeriod=600 Jul 02 17:00:08.070119 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.070070 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-646549dcf4-88tvv"] Jul 02 17:00:08.071378 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:00:08.071351 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c09c50d_3596_45c7_b7ae_62183bcbf470.slice/crio-70b82406ca0be2e1bd88cfe48724a64c37794c4f0cfd84f916d5c4bc4dedfad3 WatchSource:0}: Error finding container 70b82406ca0be2e1bd88cfe48724a64c37794c4f0cfd84f916d5c4bc4dedfad3: Status 404 returned error can't find the container with id 70b82406ca0be2e1bd88cfe48724a64c37794c4f0cfd84f916d5c4bc4dedfad3 Jul 02 17:00:08.181695 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.181670 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.252148 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252116 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252148 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252155 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-2\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252416 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252175 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252416 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252207 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-tls-assets\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252416 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252224 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-metrics-client-ca\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252416 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252244 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-kubelet-serving-ca-bundle\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252616 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252468 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-trusted-ca-bundle\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252616 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252499 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-grpc-tls\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252616 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252547 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-kube-rbac-proxy\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252616 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252612 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-metrics-client-certs\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252820 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252638 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-db\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252820 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252665 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config-out\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.252820 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252712 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.253986 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252736 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-thanos-prometheus-http-client-file\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.254628 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.252878 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:08.254628 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.253335 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:08.254628 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.253390 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:08.254628 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.253715 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:08.254628 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.254126 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:00:08.254987 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.254971 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-tls\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.255169 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.255130 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-serving-certs-ca-bundle\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.255499 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.255330 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-web-config\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.255646 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.255629 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-0\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.255811 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.255789 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbzxk\" (UniqueName: \"kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-kube-api-access-cbzxk\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.257773 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.257754 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-1\") pod \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\" (UID: \"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91\") " Jul 02 17:00:08.257991 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.255010 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:08.258574 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.255570 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:08.258574 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.257236 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:08.258574 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.257327 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:00:08.258574 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.257374 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:08.258574 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.257431 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:08.258574 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.257952 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config-out" (OuterVolumeSpecName: "config-out") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:00:08.258574 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.258176 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:08.258574 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.258463 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config" (OuterVolumeSpecName: "config") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:08.258574 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.258544 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:08.259396 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.259377 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.259533 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.259519 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.259699 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.259683 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.259818 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.259803 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.259931 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.259918 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.260091 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.260029 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.260091 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.260048 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-tls-assets\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.260091 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.260061 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-metrics-client-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.260412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.260075 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.260412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.260351 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.260412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.260365 2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-kube-rbac-proxy\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.260412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.260377 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-prometheus-k8s-db\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.260630 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.260389 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config-out\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.260630 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.260572 2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.260630 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.260586 2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.260630 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.259703 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:08.261262 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.261196 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:08.261526 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.261504 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:08.262024 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.261999 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-kube-api-access-cbzxk" (OuterVolumeSpecName: "kube-api-access-cbzxk") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "kube-api-access-cbzxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:00:08.270822 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.270782 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-web-config" (OuterVolumeSpecName: "web-config") pod "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" (UID: "b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:08.361643 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.361611 2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-grpc-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.361643 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.361639 2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-metrics-client-certs\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.361643 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.361649 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.361874 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.361657 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-web-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.361874 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.361667 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbzxk\" (UniqueName: \"kubernetes.io/projected/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91-kube-api-access-cbzxk\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:08.370438 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.370405 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" event={"ID":"1c09c50d-3596-45c7-b7ae-62183bcbf470","Type":"ContainerStarted","Data":"70b82406ca0be2e1bd88cfe48724a64c37794c4f0cfd84f916d5c4bc4dedfad3"} Jul 02 17:00:08.373238 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373212 2582 generic.go:356] "Generic (PLEG): container finished" podID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerID="9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2" exitCode=0 Jul 02 17:00:08.373238 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373235 2582 generic.go:356] "Generic (PLEG): container finished" podID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerID="83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75" exitCode=0 Jul 02 17:00:08.373238 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373241 2582 generic.go:356] "Generic (PLEG): container finished" podID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerID="33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb" exitCode=0 Jul 02 17:00:08.373473 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373247 2582 generic.go:356] "Generic (PLEG): container finished" podID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerID="5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415" exitCode=0 Jul 02 17:00:08.373473 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373252 2582 generic.go:356] "Generic (PLEG): container finished" podID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerID="cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b" exitCode=0 Jul 02 17:00:08.373473 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373257 2582 generic.go:356] "Generic (PLEG): container finished" podID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerID="c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932" exitCode=0 Jul 02 17:00:08.373473 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373304 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerDied","Data":"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2"} Jul 02 17:00:08.373473 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373321 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.373473 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373371 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerDied","Data":"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75"} Jul 02 17:00:08.373473 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373409 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerDied","Data":"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb"} Jul 02 17:00:08.373473 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373434 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerDied","Data":"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415"} Jul 02 17:00:08.373473 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373440 2582 scope.go:117] "RemoveContainer" containerID="9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2" Jul 02 17:00:08.373473 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373464 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerDied","Data":"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b"} Jul 02 17:00:08.373907 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373489 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerDied","Data":"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932"} Jul 02 17:00:08.373907 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.373521 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91","Type":"ContainerDied","Data":"d2605df67b3fcf29f5d6e3fd1e210ebf4b41c1f4baef92c192ad8d77196cf1fe"} Jul 02 17:00:08.381436 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.381214 2582 scope.go:117] "RemoveContainer" containerID="83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75" Jul 02 17:00:08.388800 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.388786 2582 scope.go:117] "RemoveContainer" containerID="33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb" Jul 02 17:00:08.395308 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.395293 2582 scope.go:117] "RemoveContainer" containerID="5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415" Jul 02 17:00:08.402389 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.402315 2582 scope.go:117] "RemoveContainer" containerID="cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b" Jul 02 17:00:08.402940 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.402922 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 17:00:08.408440 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.408420 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 17:00:08.410101 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.410085 2582 scope.go:117] "RemoveContainer" containerID="c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932" Jul 02 17:00:08.417151 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.417134 2582 scope.go:117] "RemoveContainer" containerID="976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9" Jul 02 17:00:08.423711 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.423695 2582 scope.go:117] "RemoveContainer" containerID="9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2" Jul 02 17:00:08.423953 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:08.423938 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": container with ID starting with 9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2 not found: ID does not exist" containerID="9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2" Jul 02 17:00:08.424001 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.423963 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2"} err="failed to get container status \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": rpc error: code = NotFound desc = could not find container \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": container with ID starting with 9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2 not found: ID does not exist" Jul 02 17:00:08.424001 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.423982 2582 scope.go:117] "RemoveContainer" containerID="83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75" Jul 02 17:00:08.424230 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:08.424210 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": container with ID starting with 83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75 not found: ID does not exist" containerID="83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75" Jul 02 17:00:08.424302 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.424242 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75"} err="failed to get container status \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": rpc error: code = NotFound desc = could not find container \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": container with ID starting with 83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75 not found: ID does not exist" Jul 02 17:00:08.424302 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.424267 2582 scope.go:117] "RemoveContainer" containerID="33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb" Jul 02 17:00:08.424571 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:08.424553 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": container with ID starting with 33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb not found: ID does not exist" containerID="33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb" Jul 02 17:00:08.424641 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.424575 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb"} err="failed to get container status \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": rpc error: code = NotFound desc = could not find container \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": container with ID starting with 33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb not found: ID does not exist" Jul 02 17:00:08.424641 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.424593 2582 scope.go:117] "RemoveContainer" containerID="5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415" Jul 02 17:00:08.424800 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:08.424786 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": container with ID starting with 5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415 not found: ID does not exist" containerID="5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415" Jul 02 17:00:08.424835 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.424803 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415"} err="failed to get container status \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": rpc error: code = NotFound desc = could not find container \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": container with ID starting with 5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415 not found: ID does not exist" Jul 02 17:00:08.424835 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.424821 2582 scope.go:117] "RemoveContainer" containerID="cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b" Jul 02 17:00:08.425005 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:08.424991 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": container with ID starting with cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b not found: ID does not exist" containerID="cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b" Jul 02 17:00:08.425041 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.425010 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b"} err="failed to get container status \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": rpc error: code = NotFound desc = could not find container \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": container with ID starting with cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b not found: ID does not exist" Jul 02 17:00:08.425041 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.425025 2582 scope.go:117] "RemoveContainer" containerID="c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932" Jul 02 17:00:08.425301 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:08.425266 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": container with ID starting with c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932 not found: ID does not exist" containerID="c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932" Jul 02 17:00:08.425370 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.425307 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932"} err="failed to get container status \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": rpc error: code = NotFound desc = could not find container \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": container with ID starting with c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932 not found: ID does not exist" Jul 02 17:00:08.425370 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.425325 2582 scope.go:117] "RemoveContainer" containerID="976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9" Jul 02 17:00:08.425603 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:08.425589 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": container with ID starting with 976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9 not found: ID does not exist" containerID="976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9" Jul 02 17:00:08.425646 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.425607 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9"} err="failed to get container status \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": rpc error: code = NotFound desc = could not find container \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": container with ID starting with 976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9 not found: ID does not exist" Jul 02 17:00:08.425646 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.425621 2582 scope.go:117] "RemoveContainer" containerID="9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2" Jul 02 17:00:08.425854 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.425838 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2"} err="failed to get container status \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": rpc error: code = NotFound desc = could not find container \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": container with ID starting with 9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2 not found: ID does not exist" Jul 02 17:00:08.425901 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.425854 2582 scope.go:117] "RemoveContainer" containerID="83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75" Jul 02 17:00:08.426067 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.426048 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75"} err="failed to get container status \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": rpc error: code = NotFound desc = could not find container \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": container with ID starting with 83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75 not found: ID does not exist" Jul 02 17:00:08.426126 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.426070 2582 scope.go:117] "RemoveContainer" containerID="33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb" Jul 02 17:00:08.426273 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.426254 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb"} err="failed to get container status \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": rpc error: code = NotFound desc = could not find container \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": container with ID starting with 33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb not found: ID does not exist" Jul 02 17:00:08.426273 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.426273 2582 scope.go:117] "RemoveContainer" containerID="5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415" Jul 02 17:00:08.426513 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.426495 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415"} err="failed to get container status \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": rpc error: code = NotFound desc = could not find container \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": container with ID starting with 5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415 not found: ID does not exist" Jul 02 17:00:08.426556 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.426515 2582 scope.go:117] "RemoveContainer" containerID="cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b" Jul 02 17:00:08.426711 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.426694 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b"} err="failed to get container status \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": rpc error: code = NotFound desc = could not find container \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": container with ID starting with cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b not found: ID does not exist" Jul 02 17:00:08.426751 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.426712 2582 scope.go:117] "RemoveContainer" containerID="c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932" Jul 02 17:00:08.426944 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.426924 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932"} err="failed to get container status \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": rpc error: code = NotFound desc = could not find container \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": container with ID starting with c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932 not found: ID does not exist" Jul 02 17:00:08.426944 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.426943 2582 scope.go:117] "RemoveContainer" containerID="976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9" Jul 02 17:00:08.427143 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.427126 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9"} err="failed to get container status \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": rpc error: code = NotFound desc = could not find container \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": container with ID starting with 976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9 not found: ID does not exist" Jul 02 17:00:08.427195 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.427143 2582 scope.go:117] "RemoveContainer" containerID="9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2" Jul 02 17:00:08.427363 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.427347 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2"} err="failed to get container status \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": rpc error: code = NotFound desc = could not find container \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": container with ID starting with 9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2 not found: ID does not exist" Jul 02 17:00:08.427414 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.427363 2582 scope.go:117] "RemoveContainer" containerID="83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75" Jul 02 17:00:08.427543 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.427527 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75"} err="failed to get container status \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": rpc error: code = NotFound desc = could not find container \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": container with ID starting with 83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75 not found: ID does not exist" Jul 02 17:00:08.427589 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.427545 2582 scope.go:117] "RemoveContainer" containerID="33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb" Jul 02 17:00:08.427750 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.427736 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb"} err="failed to get container status \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": rpc error: code = NotFound desc = could not find container \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": container with ID starting with 33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb not found: ID does not exist" Jul 02 17:00:08.427787 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.427751 2582 scope.go:117] "RemoveContainer" containerID="5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415" Jul 02 17:00:08.427962 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.427938 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415"} err="failed to get container status \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": rpc error: code = NotFound desc = could not find container \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": container with ID starting with 5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415 not found: ID does not exist" Jul 02 17:00:08.428001 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.427964 2582 scope.go:117] "RemoveContainer" containerID="cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b" Jul 02 17:00:08.428152 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.428133 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b"} err="failed to get container status \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": rpc error: code = NotFound desc = could not find container \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": container with ID starting with cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b not found: ID does not exist" Jul 02 17:00:08.428195 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.428153 2582 scope.go:117] "RemoveContainer" containerID="c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932" Jul 02 17:00:08.428442 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.428420 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932"} err="failed to get container status \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": rpc error: code = NotFound desc = could not find container \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": container with ID starting with c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932 not found: ID does not exist" Jul 02 17:00:08.428520 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.428443 2582 scope.go:117] "RemoveContainer" containerID="976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9" Jul 02 17:00:08.428674 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.428659 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9"} err="failed to get container status \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": rpc error: code = NotFound desc = could not find container \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": container with ID starting with 976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9 not found: ID does not exist" Jul 02 17:00:08.428719 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.428675 2582 scope.go:117] "RemoveContainer" containerID="9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2" Jul 02 17:00:08.428881 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.428864 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2"} err="failed to get container status \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": rpc error: code = NotFound desc = could not find container \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": container with ID starting with 9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2 not found: ID does not exist" Jul 02 17:00:08.428928 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.428883 2582 scope.go:117] "RemoveContainer" containerID="83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75" Jul 02 17:00:08.429122 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.429105 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75"} err="failed to get container status \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": rpc error: code = NotFound desc = could not find container \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": container with ID starting with 83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75 not found: ID does not exist" Jul 02 17:00:08.429194 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.429124 2582 scope.go:117] "RemoveContainer" containerID="33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb" Jul 02 17:00:08.429389 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.429363 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb"} err="failed to get container status \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": rpc error: code = NotFound desc = could not find container \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": container with ID starting with 33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb not found: ID does not exist" Jul 02 17:00:08.429389 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.429384 2582 scope.go:117] "RemoveContainer" containerID="5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415" Jul 02 17:00:08.429615 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.429592 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415"} err="failed to get container status \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": rpc error: code = NotFound desc = could not find container \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": container with ID starting with 5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415 not found: ID does not exist" Jul 02 17:00:08.429615 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.429610 2582 scope.go:117] "RemoveContainer" containerID="cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b" Jul 02 17:00:08.429812 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.429797 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b"} err="failed to get container status \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": rpc error: code = NotFound desc = could not find container \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": container with ID starting with cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b not found: ID does not exist" Jul 02 17:00:08.429860 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.429812 2582 scope.go:117] "RemoveContainer" containerID="c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932" Jul 02 17:00:08.430051 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430034 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932"} err="failed to get container status \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": rpc error: code = NotFound desc = could not find container \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": container with ID starting with c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932 not found: ID does not exist" Jul 02 17:00:08.430122 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430053 2582 scope.go:117] "RemoveContainer" containerID="976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9" Jul 02 17:00:08.430249 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430233 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9"} err="failed to get container status \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": rpc error: code = NotFound desc = could not find container \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": container with ID starting with 976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9 not found: ID does not exist" Jul 02 17:00:08.430317 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430249 2582 scope.go:117] "RemoveContainer" containerID="9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2" Jul 02 17:00:08.430437 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430422 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2"} err="failed to get container status \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": rpc error: code = NotFound desc = could not find container \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": container with ID starting with 9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2 not found: ID does not exist" Jul 02 17:00:08.430486 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430437 2582 scope.go:117] "RemoveContainer" containerID="83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75" Jul 02 17:00:08.430632 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430617 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75"} err="failed to get container status \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": rpc error: code = NotFound desc = could not find container \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": container with ID starting with 83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75 not found: ID does not exist" Jul 02 17:00:08.430672 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430632 2582 scope.go:117] "RemoveContainer" containerID="33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb" Jul 02 17:00:08.430815 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430800 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb"} err="failed to get container status \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": rpc error: code = NotFound desc = could not find container \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": container with ID starting with 33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb not found: ID does not exist" Jul 02 17:00:08.430864 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430816 2582 scope.go:117] "RemoveContainer" containerID="5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415" Jul 02 17:00:08.430989 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430974 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415"} err="failed to get container status \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": rpc error: code = NotFound desc = could not find container \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": container with ID starting with 5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415 not found: ID does not exist" Jul 02 17:00:08.431034 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.430989 2582 scope.go:117] "RemoveContainer" containerID="cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b" Jul 02 17:00:08.431175 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.431146 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b"} err="failed to get container status \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": rpc error: code = NotFound desc = could not find container \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": container with ID starting with cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b not found: ID does not exist" Jul 02 17:00:08.431175 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.431174 2582 scope.go:117] "RemoveContainer" containerID="c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932" Jul 02 17:00:08.431377 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.431359 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932"} err="failed to get container status \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": rpc error: code = NotFound desc = could not find container \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": container with ID starting with c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932 not found: ID does not exist" Jul 02 17:00:08.431453 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.431380 2582 scope.go:117] "RemoveContainer" containerID="976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9" Jul 02 17:00:08.431580 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.431564 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9"} err="failed to get container status \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": rpc error: code = NotFound desc = could not find container \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": container with ID starting with 976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9 not found: ID does not exist" Jul 02 17:00:08.431640 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.431581 2582 scope.go:117] "RemoveContainer" containerID="9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2" Jul 02 17:00:08.431783 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.431768 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2"} err="failed to get container status \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": rpc error: code = NotFound desc = could not find container \"9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2\": container with ID starting with 9e60f44caa00837bf05e125579d2342cb7cf57118f47d02f6c2352b140394fe2 not found: ID does not exist" Jul 02 17:00:08.431829 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.431783 2582 scope.go:117] "RemoveContainer" containerID="83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75" Jul 02 17:00:08.431966 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.431950 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75"} err="failed to get container status \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": rpc error: code = NotFound desc = could not find container \"83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75\": container with ID starting with 83bfc8a45e358403f57c493fba85dda10e02d153041c09cccf399a64c0410c75 not found: ID does not exist" Jul 02 17:00:08.432012 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.431966 2582 scope.go:117] "RemoveContainer" containerID="33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb" Jul 02 17:00:08.432162 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.432145 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb"} err="failed to get container status \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": rpc error: code = NotFound desc = could not find container \"33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb\": container with ID starting with 33eaee621bb9d72ceefc08eb4e8b1810febae08488d9931e13a85ab976fb07cb not found: ID does not exist" Jul 02 17:00:08.432162 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.432161 2582 scope.go:117] "RemoveContainer" containerID="5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415" Jul 02 17:00:08.432475 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.432432 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415"} err="failed to get container status \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": rpc error: code = NotFound desc = could not find container \"5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415\": container with ID starting with 5ca7f219370fd9b5a3c6394e422e509dc66d37f5f8b0316272c6d51e207a0415 not found: ID does not exist" Jul 02 17:00:08.432475 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.432459 2582 scope.go:117] "RemoveContainer" containerID="cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b" Jul 02 17:00:08.432716 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.432697 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b"} err="failed to get container status \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": rpc error: code = NotFound desc = could not find container \"cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b\": container with ID starting with cd9cbc3cae6970ca65f8d1da8789356da80c88f46356d70fbdc0045f5e70580b not found: ID does not exist" Jul 02 17:00:08.432716 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.432715 2582 scope.go:117] "RemoveContainer" containerID="c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932" Jul 02 17:00:08.433064 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.432978 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932"} err="failed to get container status \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": rpc error: code = NotFound desc = could not find container \"c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932\": container with ID starting with c8f4df65fef31bd0051d635308fc1f7e414fe7df3063d6573691aaee6a5ae932 not found: ID does not exist" Jul 02 17:00:08.433064 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.433002 2582 scope.go:117] "RemoveContainer" containerID="976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9" Jul 02 17:00:08.433268 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.433250 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9"} err="failed to get container status \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": rpc error: code = NotFound desc = could not find container \"976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9\": container with ID starting with 976b0f82b67fa6a37ae0fbef1f6508048b1ea2cbf2ae859c870bbcd6fb802ab9 not found: ID does not exist" Jul 02 17:00:08.445082 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445062 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 17:00:08.445391 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445377 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="config-reloader" Jul 02 17:00:08.445439 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445393 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="config-reloader" Jul 02 17:00:08.445439 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445403 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy-thanos" Jul 02 17:00:08.445439 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445409 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy-thanos" Jul 02 17:00:08.445439 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445416 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy-web" Jul 02 17:00:08.445439 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445422 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy-web" Jul 02 17:00:08.445439 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445434 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="prometheus" Jul 02 17:00:08.445439 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445439 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="prometheus" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445447 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="init-config-reloader" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445452 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="init-config-reloader" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445458 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="thanos-sidecar" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445463 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="thanos-sidecar" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445473 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445478 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445524 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445530 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy-web" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445537 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="prometheus" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445542 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="config-reloader" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445548 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="kube-rbac-proxy-thanos" Jul 02 17:00:08.445637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.445553 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" containerName="thanos-sidecar" Jul 02 17:00:08.450794 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.450775 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.456557 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.456538 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 17:00:08.457771 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.457752 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4dzh5\"" Jul 02 17:00:08.458137 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.458116 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 17:00:08.458588 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.458568 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 17:00:08.458588 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.458569 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 17:00:08.459167 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.459135 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 17:00:08.459267 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.459187 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 17:00:08.459267 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.459188 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 17:00:08.459415 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.459263 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 17:00:08.459415 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.459362 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 17:00:08.459415 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.459397 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 17:00:08.459737 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.459719 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 17:00:08.459854 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.459743 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 17:00:08.459854 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.459766 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4guvf1gusm4pa\"" Jul 02 17:00:08.463027 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.463009 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 17:00:08.471288 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.468585 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 17:00:08.479237 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.479211 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 17:00:08.563060 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563022 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563060 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563063 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563335 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563086 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563335 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563109 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563335 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563129 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563335 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563152 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563335 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563202 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fee584a-7f1d-4c90-a0ae-007c9024441d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563335 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563227 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563335 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563318 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563610 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563364 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563610 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563392 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llgkq\" (UniqueName: \"kubernetes.io/projected/8fee584a-7f1d-4c90-a0ae-007c9024441d-kube-api-access-llgkq\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563610 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563428 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563610 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563489 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-web-config\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563610 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563530 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563610 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563559 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563817 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563620 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-config\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563817 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563645 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563817 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563666 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fee584a-7f1d-4c90-a0ae-007c9024441d-config-out\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563817 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563727 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.563817 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.563761 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.664543 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.664508 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.664543 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.664549 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.664788 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.664566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.664788 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.664706 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.664788 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.664747 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.664788 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.664776 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.664983 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.664808 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fee584a-7f1d-4c90-a0ae-007c9024441d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.664983 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.664843 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.664983 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.664878 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.664983 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.664919 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.664983 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.664951 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llgkq\" (UniqueName: \"kubernetes.io/projected/8fee584a-7f1d-4c90-a0ae-007c9024441d-kube-api-access-llgkq\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665235 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665013 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665235 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-web-config\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665235 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665079 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665235 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665119 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665235 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665154 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-config\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665235 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665178 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665235 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665205 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fee584a-7f1d-4c90-a0ae-007c9024441d-config-out\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665235 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665228 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665642 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665243 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665642 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665251 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665642 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665507 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.665801 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665694 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.667191 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.665887 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.667191 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.666409 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.668412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.667433 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.668412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.667722 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.668412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.667911 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.668412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.667927 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.668412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.668232 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.668412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.668372 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.669428 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.669398 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fee584a-7f1d-4c90-a0ae-007c9024441d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.669428 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.669422 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-web-config\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.669791 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.669754 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-config\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.669884 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.669795 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.669985 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.669913 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fee584a-7f1d-4c90-a0ae-007c9024441d-config-out\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.670047 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.670029 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.670141 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.670119 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8fee584a-7f1d-4c90-a0ae-007c9024441d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.670846 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.670827 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fee584a-7f1d-4c90-a0ae-007c9024441d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.675408 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.675368 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llgkq\" (UniqueName: \"kubernetes.io/projected/8fee584a-7f1d-4c90-a0ae-007c9024441d-kube-api-access-llgkq\") pod \"prometheus-k8s-0\" (UID: \"8fee584a-7f1d-4c90-a0ae-007c9024441d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.761538 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.761500 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:08.916580 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:08.916555 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 17:00:08.919408 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:00:08.919375 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fee584a_7f1d_4c90_a0ae_007c9024441d.slice/crio-989017522b7583b1cc667f88711af2a41ab5f1a960cad630568982e968fb6dc7 WatchSource:0}: Error finding container 989017522b7583b1cc667f88711af2a41ab5f1a960cad630568982e968fb6dc7: Status 404 returned error can't find the container with id 989017522b7583b1cc667f88711af2a41ab5f1a960cad630568982e968fb6dc7 Jul 02 17:00:09.381143 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:09.381087 2582 generic.go:356] "Generic (PLEG): container finished" podID="8fee584a-7f1d-4c90-a0ae-007c9024441d" containerID="1a9e0a42428d5d0bce9c235a3d421e2ce34adcc988d47a2b68fc520bb911df0f" exitCode=0 Jul 02 17:00:09.381607 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:09.381147 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fee584a-7f1d-4c90-a0ae-007c9024441d","Type":"ContainerDied","Data":"1a9e0a42428d5d0bce9c235a3d421e2ce34adcc988d47a2b68fc520bb911df0f"} Jul 02 17:00:09.381607 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:09.381224 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fee584a-7f1d-4c90-a0ae-007c9024441d","Type":"ContainerStarted","Data":"989017522b7583b1cc667f88711af2a41ab5f1a960cad630568982e968fb6dc7"} Jul 02 17:00:09.619908 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:09.619866 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91" path="/var/lib/kubelet/pods/b5e66b6e-ffb9-4e54-b1c1-6ff03f623f91/volumes" Jul 02 17:00:10.388686 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:10.388649 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fee584a-7f1d-4c90-a0ae-007c9024441d","Type":"ContainerStarted","Data":"24fe3b38c22ff0296d9a0a4de669a719df6d732c99d9e33e7baf5822b3474343"} Jul 02 17:00:10.389132 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:10.388719 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fee584a-7f1d-4c90-a0ae-007c9024441d","Type":"ContainerStarted","Data":"65f0129f81d35b23afd47fd14230002ebdfba593e47331dfe743cafac030fc7d"} Jul 02 17:00:10.389132 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:10.388759 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fee584a-7f1d-4c90-a0ae-007c9024441d","Type":"ContainerStarted","Data":"e15e7b8fd551b09ac8fcd42fc9325556710442e7c59a2fc22d95c6ea6c39c549"} Jul 02 17:00:10.389132 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:10.388799 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fee584a-7f1d-4c90-a0ae-007c9024441d","Type":"ContainerStarted","Data":"956092c9d87f58c25a14cf0bde6a2b4fae00b47c29518712089c5a2b002a4bd5"} Jul 02 17:00:10.389132 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:10.388828 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fee584a-7f1d-4c90-a0ae-007c9024441d","Type":"ContainerStarted","Data":"91edec86eb4914f1fef2e52109dfd30522fdc241fe6bf22bc494ebe89b3f3892"} Jul 02 17:00:10.389132 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:10.388852 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fee584a-7f1d-4c90-a0ae-007c9024441d","Type":"ContainerStarted","Data":"4d06839e58af6cac2051f3e468071e38e65353749748cad44559b22fcc5eda9d"} Jul 02 17:00:10.390726 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:10.390699 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" event={"ID":"1c09c50d-3596-45c7-b7ae-62183bcbf470","Type":"ContainerStarted","Data":"e6a0ba57b50f9fb406c350c5fa489b476068e386b4a8d8dbd2352375863b3832"} Jul 02 17:00:10.390851 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:10.390760 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" event={"ID":"1c09c50d-3596-45c7-b7ae-62183bcbf470","Type":"ContainerStarted","Data":"ecb4072c917f9b32596fb4e64ab6374d4ad3702c4428b531ded522dca6f8e9a3"} Jul 02 17:00:10.390851 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:10.390783 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" event={"ID":"1c09c50d-3596-45c7-b7ae-62183bcbf470","Type":"ContainerStarted","Data":"9e72c9f65f6894c4e44eaaeab9f92d09c4760ae41f2fb0434e7d95d4fd74c867"} Jul 02 17:00:10.426731 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:10.426684 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.405330585 podStartE2EDuration="2.426669063s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.338478ms" isStatefulPod=false podCreationTimestamp="2026-07-02 17:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:00:10.424969515 +0000 UTC m=+160.978811947" watchObservedRunningTime="2026-07-02 17:00:10.426669063 +0000 UTC m=+160.980511483" Jul 02 17:00:10.452434 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:10.452391 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-646549dcf4-88tvv" podStartSLOduration=1.76020519 podStartE2EDuration="3.452376097s" totalImagesPullingTime="1.692170907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:00:10.449858703 +0000 UTC m=+161.003701123" watchObservedRunningTime="2026-07-02 17:00:10.452376097 +0000 UTC m=+161.006218518" Jul 02 17:00:11.105557 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.105522 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-566fb9f54c-5vlsm"] Jul 02 17:00:11.109936 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.109916 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.125460 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.125438 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566fb9f54c-5vlsm"] Jul 02 17:00:11.291369 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.291328 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-config\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.291528 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.291377 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-trusted-ca-bundle\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.291528 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.291464 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-service-ca\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.291528 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.291506 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpr6m\" (UniqueName: \"kubernetes.io/projected/1600d509-9b23-4da1-bd9b-db778a5d94d2-kube-api-access-vpr6m\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.291706 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.291540 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-oauth-config\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.291706 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.291604 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-oauth-serving-cert\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.291706 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.291650 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-serving-cert\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.392148 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.392062 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-config\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.392148 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.392102 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-trusted-ca-bundle\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.392148 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.392144 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-service-ca\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.392736 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.392178 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpr6m\" (UniqueName: \"kubernetes.io/projected/1600d509-9b23-4da1-bd9b-db778a5d94d2-kube-api-access-vpr6m\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.392736 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.392206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-oauth-config\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.392736 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.392257 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-oauth-serving-cert\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.392736 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.392322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-serving-cert\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.393014 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.392986 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-config\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.393075 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.393044 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-service-ca\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.393135 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.393077 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-oauth-serving-cert\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.393186 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.393171 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-trusted-ca-bundle\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.394803 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.394775 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-serving-cert\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.395047 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.395026 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-oauth-config\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.402468 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.402443 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpr6m\" (UniqueName: \"kubernetes.io/projected/1600d509-9b23-4da1-bd9b-db778a5d94d2-kube-api-access-vpr6m\") pod \"console-566fb9f54c-5vlsm\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.419256 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.419234 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:11.584099 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:11.584075 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566fb9f54c-5vlsm"] Jul 02 17:00:11.586510 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:00:11.586483 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1600d509_9b23_4da1_bd9b_db778a5d94d2.slice/crio-f7e4a83543836b6c416c91070c736804bf746e74e0699d8844155e29c66f7101 WatchSource:0}: Error finding container f7e4a83543836b6c416c91070c736804bf746e74e0699d8844155e29c66f7101: Status 404 returned error can't find the container with id f7e4a83543836b6c416c91070c736804bf746e74e0699d8844155e29c66f7101 Jul 02 17:00:12.402349 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:12.402310 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566fb9f54c-5vlsm" event={"ID":"1600d509-9b23-4da1-bd9b-db778a5d94d2","Type":"ContainerStarted","Data":"07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04"} Jul 02 17:00:12.402711 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:12.402387 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566fb9f54c-5vlsm" event={"ID":"1600d509-9b23-4da1-bd9b-db778a5d94d2","Type":"ContainerStarted","Data":"f7e4a83543836b6c416c91070c736804bf746e74e0699d8844155e29c66f7101"} Jul 02 17:00:12.427099 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:12.427048 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-566fb9f54c-5vlsm" podStartSLOduration=1.4270331330000001 podStartE2EDuration="1.427033133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:00:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:00:12.425835186 +0000 UTC m=+162.979677620" watchObservedRunningTime="2026-07-02 17:00:12.427033133 +0000 UTC m=+162.980875553" Jul 02 17:00:13.762116 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:13.762075 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:00:21.420116 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:21.420060 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:21.420546 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:21.420143 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:21.424803 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:21.424781 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:21.444291 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:21.444259 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:00:21.536706 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:21.536677 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64bd68fdc8-hfghl"] Jul 02 17:00:46.556354 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.556272 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64bd68fdc8-hfghl" podUID="6087cf2e-2e2c-44f0-812c-533a42038ea2" containerName="console" containerID="cri-o://efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4" gracePeriod=15 Jul 02 17:00:46.816680 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.816627 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 17:00:46.924609 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.924573 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-service-ca\") pod \"6087cf2e-2e2c-44f0-812c-533a42038ea2\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " Jul 02 17:00:46.924785 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.924622 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-trusted-ca-bundle\") pod \"6087cf2e-2e2c-44f0-812c-533a42038ea2\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " Jul 02 17:00:46.924785 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.924730 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29rjk\" (UniqueName: \"kubernetes.io/projected/6087cf2e-2e2c-44f0-812c-533a42038ea2-kube-api-access-29rjk\") pod \"6087cf2e-2e2c-44f0-812c-533a42038ea2\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " Jul 02 17:00:46.924785 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.924764 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-oauth-serving-cert\") pod \"6087cf2e-2e2c-44f0-812c-533a42038ea2\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " Jul 02 17:00:46.924954 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.924932 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-oauth-config\") pod \"6087cf2e-2e2c-44f0-812c-533a42038ea2\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " Jul 02 17:00:46.925013 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.924968 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-config\") pod \"6087cf2e-2e2c-44f0-812c-533a42038ea2\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " Jul 02 17:00:46.925013 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.925005 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-serving-cert\") pod \"6087cf2e-2e2c-44f0-812c-533a42038ea2\" (UID: \"6087cf2e-2e2c-44f0-812c-533a42038ea2\") " Jul 02 17:00:46.925118 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.924930 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-service-ca" (OuterVolumeSpecName: "service-ca") pod "6087cf2e-2e2c-44f0-812c-533a42038ea2" (UID: "6087cf2e-2e2c-44f0-812c-533a42038ea2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:46.925118 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.925005 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6087cf2e-2e2c-44f0-812c-533a42038ea2" (UID: "6087cf2e-2e2c-44f0-812c-533a42038ea2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:46.925218 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.925113 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6087cf2e-2e2c-44f0-812c-533a42038ea2" (UID: "6087cf2e-2e2c-44f0-812c-533a42038ea2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:46.925366 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.925333 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-config" (OuterVolumeSpecName: "console-config") pod "6087cf2e-2e2c-44f0-812c-533a42038ea2" (UID: "6087cf2e-2e2c-44f0-812c-533a42038ea2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:00:46.925465 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.925379 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-oauth-serving-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:46.925465 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.925398 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:46.925465 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.925411 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-trusted-ca-bundle\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:46.926955 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.926932 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6087cf2e-2e2c-44f0-812c-533a42038ea2-kube-api-access-29rjk" (OuterVolumeSpecName: "kube-api-access-29rjk") pod "6087cf2e-2e2c-44f0-812c-533a42038ea2" (UID: "6087cf2e-2e2c-44f0-812c-533a42038ea2"). InnerVolumeSpecName "kube-api-access-29rjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:00:46.927061 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.926987 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6087cf2e-2e2c-44f0-812c-533a42038ea2" (UID: "6087cf2e-2e2c-44f0-812c-533a42038ea2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:46.927061 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:46.927048 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6087cf2e-2e2c-44f0-812c-533a42038ea2" (UID: "6087cf2e-2e2c-44f0-812c-533a42038ea2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:00:47.026306 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.026247 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29rjk\" (UniqueName: \"kubernetes.io/projected/6087cf2e-2e2c-44f0-812c-533a42038ea2-kube-api-access-29rjk\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:47.026306 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.026306 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-oauth-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:47.026498 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.026322 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:47.026498 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.026336 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6087cf2e-2e2c-44f0-812c-533a42038ea2-console-serving-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:00:47.546097 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.546064 2582 generic.go:356] "Generic (PLEG): container finished" podID="6087cf2e-2e2c-44f0-812c-533a42038ea2" containerID="efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4" exitCode=0 Jul 02 17:00:47.546310 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.546112 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bd68fdc8-hfghl" Jul 02 17:00:47.546310 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.546134 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bd68fdc8-hfghl" event={"ID":"6087cf2e-2e2c-44f0-812c-533a42038ea2","Type":"ContainerDied","Data":"efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4"} Jul 02 17:00:47.546310 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.546182 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bd68fdc8-hfghl" event={"ID":"6087cf2e-2e2c-44f0-812c-533a42038ea2","Type":"ContainerDied","Data":"267a84697a347f3de14ee260752f443b13ed5e7b875e179e2f117c9c6a5c1949"} Jul 02 17:00:47.546310 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.546207 2582 scope.go:117] "RemoveContainer" containerID="efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4" Jul 02 17:00:47.554730 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.554713 2582 scope.go:117] "RemoveContainer" containerID="efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4" Jul 02 17:00:47.554976 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:00:47.554955 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4\": container with ID starting with efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4 not found: ID does not exist" containerID="efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4" Jul 02 17:00:47.555035 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.554985 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4"} err="failed to get container status \"efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4\": rpc error: code = NotFound desc = could not find container \"efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4\": container with ID starting with efd84cd974a2889949f9c02ded6cac81cf053bf2cdd065b29d0f73c487f8aee4 not found: ID does not exist" Jul 02 17:00:47.571019 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.570997 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64bd68fdc8-hfghl"] Jul 02 17:00:47.575470 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.575451 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64bd68fdc8-hfghl"] Jul 02 17:00:47.618118 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:00:47.618094 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6087cf2e-2e2c-44f0-812c-533a42038ea2" path="/var/lib/kubelet/pods/6087cf2e-2e2c-44f0-812c-533a42038ea2/volumes" Jul 02 17:01:08.761664 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:08.761632 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:01:08.776580 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:08.776555 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:01:09.659783 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:09.659760 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 17:01:25.699833 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.699798 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6496694d4b-bwcxc"] Jul 02 17:01:25.700354 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.700112 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6087cf2e-2e2c-44f0-812c-533a42038ea2" containerName="console" Jul 02 17:01:25.700354 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.700123 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6087cf2e-2e2c-44f0-812c-533a42038ea2" containerName="console" Jul 02 17:01:25.700354 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.700194 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6087cf2e-2e2c-44f0-812c-533a42038ea2" containerName="console" Jul 02 17:01:25.702687 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.702670 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.713535 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.713514 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6496694d4b-bwcxc"] Jul 02 17:01:25.754164 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.754134 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-console-config\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.754326 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.754167 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqmjc\" (UniqueName: \"kubernetes.io/projected/41831afe-151f-4e2b-a874-85459e1b9d5d-kube-api-access-cqmjc\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.754326 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.754192 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-oauth-serving-cert\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.754326 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.754207 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-service-ca\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.754326 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.754260 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-serving-cert\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.754326 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.754301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-trusted-ca-bundle\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.754510 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.754341 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-oauth-config\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.855246 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.855212 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-console-config\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.855246 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.855252 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqmjc\" (UniqueName: \"kubernetes.io/projected/41831afe-151f-4e2b-a874-85459e1b9d5d-kube-api-access-cqmjc\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.855472 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.855300 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-oauth-serving-cert\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.855472 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.855328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-service-ca\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.855584 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.855479 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-serving-cert\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.855584 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.855532 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-trusted-ca-bundle\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.855678 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.855601 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-oauth-config\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.856073 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.856042 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-console-config\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.856073 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.856069 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-oauth-serving-cert\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.856226 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.856042 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-service-ca\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.856391 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.856369 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-trusted-ca-bundle\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.857935 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.857906 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-serving-cert\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.857935 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.857928 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-oauth-config\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:25.867913 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:25.867893 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqmjc\" (UniqueName: \"kubernetes.io/projected/41831afe-151f-4e2b-a874-85459e1b9d5d-kube-api-access-cqmjc\") pod \"console-6496694d4b-bwcxc\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:26.011872 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:26.011787 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:26.138125 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:26.138099 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6496694d4b-bwcxc"] Jul 02 17:01:26.140683 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:01:26.140649 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41831afe_151f_4e2b_a874_85459e1b9d5d.slice/crio-ee7bc7079a16e94e7f59f2c5002b550813f8345d0f98409af8f55c08d1113f95 WatchSource:0}: Error finding container ee7bc7079a16e94e7f59f2c5002b550813f8345d0f98409af8f55c08d1113f95: Status 404 returned error can't find the container with id ee7bc7079a16e94e7f59f2c5002b550813f8345d0f98409af8f55c08d1113f95 Jul 02 17:01:26.711219 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:26.711184 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496694d4b-bwcxc" event={"ID":"41831afe-151f-4e2b-a874-85459e1b9d5d","Type":"ContainerStarted","Data":"0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085"} Jul 02 17:01:26.711729 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:26.711233 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496694d4b-bwcxc" event={"ID":"41831afe-151f-4e2b-a874-85459e1b9d5d","Type":"ContainerStarted","Data":"ee7bc7079a16e94e7f59f2c5002b550813f8345d0f98409af8f55c08d1113f95"} Jul 02 17:01:26.730778 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:26.730729 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6496694d4b-bwcxc" podStartSLOduration=1.7307134830000002 podStartE2EDuration="1.730713483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:01:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:01:26.729211213 +0000 UTC m=+237.283053685" watchObservedRunningTime="2026-07-02 17:01:26.730713483 +0000 UTC m=+237.284555904" Jul 02 17:01:36.012429 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:36.012387 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:36.012915 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:36.012451 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:36.017135 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:36.017111 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:36.758662 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:36.758635 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:01:36.802861 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:01:36.802828 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566fb9f54c-5vlsm"] Jul 02 17:02:01.824571 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:01.824472 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-566fb9f54c-5vlsm" podUID="1600d509-9b23-4da1-bd9b-db778a5d94d2" containerName="console" containerID="cri-o://07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04" gracePeriod=15 Jul 02 17:02:02.080357 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.080300 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:02:02.185456 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.185428 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-trusted-ca-bundle\") pod \"1600d509-9b23-4da1-bd9b-db778a5d94d2\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " Jul 02 17:02:02.185643 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.185484 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpr6m\" (UniqueName: \"kubernetes.io/projected/1600d509-9b23-4da1-bd9b-db778a5d94d2-kube-api-access-vpr6m\") pod \"1600d509-9b23-4da1-bd9b-db778a5d94d2\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " Jul 02 17:02:02.185643 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.185515 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-serving-cert\") pod \"1600d509-9b23-4da1-bd9b-db778a5d94d2\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " Jul 02 17:02:02.185643 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.185547 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-service-ca\") pod \"1600d509-9b23-4da1-bd9b-db778a5d94d2\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " Jul 02 17:02:02.185643 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.185569 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-oauth-config\") pod \"1600d509-9b23-4da1-bd9b-db778a5d94d2\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " Jul 02 17:02:02.185643 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.185608 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-config\") pod \"1600d509-9b23-4da1-bd9b-db778a5d94d2\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " Jul 02 17:02:02.185841 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.185755 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-oauth-serving-cert\") pod \"1600d509-9b23-4da1-bd9b-db778a5d94d2\" (UID: \"1600d509-9b23-4da1-bd9b-db778a5d94d2\") " Jul 02 17:02:02.185879 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.185831 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1600d509-9b23-4da1-bd9b-db778a5d94d2" (UID: "1600d509-9b23-4da1-bd9b-db778a5d94d2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:02:02.186079 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.186061 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-trusted-ca-bundle\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:02:02.186479 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.186451 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-service-ca" (OuterVolumeSpecName: "service-ca") pod "1600d509-9b23-4da1-bd9b-db778a5d94d2" (UID: "1600d509-9b23-4da1-bd9b-db778a5d94d2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:02:02.186658 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.186499 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1600d509-9b23-4da1-bd9b-db778a5d94d2" (UID: "1600d509-9b23-4da1-bd9b-db778a5d94d2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:02:02.186658 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.186631 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-config" (OuterVolumeSpecName: "console-config") pod "1600d509-9b23-4da1-bd9b-db778a5d94d2" (UID: "1600d509-9b23-4da1-bd9b-db778a5d94d2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:02:02.188034 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.188008 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1600d509-9b23-4da1-bd9b-db778a5d94d2-kube-api-access-vpr6m" (OuterVolumeSpecName: "kube-api-access-vpr6m") pod "1600d509-9b23-4da1-bd9b-db778a5d94d2" (UID: "1600d509-9b23-4da1-bd9b-db778a5d94d2"). InnerVolumeSpecName "kube-api-access-vpr6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:02:02.188157 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.188036 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1600d509-9b23-4da1-bd9b-db778a5d94d2" (UID: "1600d509-9b23-4da1-bd9b-db778a5d94d2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:02:02.188227 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.188157 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1600d509-9b23-4da1-bd9b-db778a5d94d2" (UID: "1600d509-9b23-4da1-bd9b-db778a5d94d2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:02:02.287037 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.286993 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpr6m\" (UniqueName: \"kubernetes.io/projected/1600d509-9b23-4da1-bd9b-db778a5d94d2-kube-api-access-vpr6m\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:02:02.287037 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.287028 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-serving-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:02:02.287037 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.287038 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:02:02.287037 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.287046 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-oauth-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:02:02.287344 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.287054 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-console-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:02:02.287344 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.287063 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1600d509-9b23-4da1-bd9b-db778a5d94d2-oauth-serving-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:02:02.861882 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.861850 2582 generic.go:356] "Generic (PLEG): container finished" podID="1600d509-9b23-4da1-bd9b-db778a5d94d2" containerID="07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04" exitCode=0 Jul 02 17:02:02.862272 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.861897 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566fb9f54c-5vlsm" Jul 02 17:02:02.862272 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.861907 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566fb9f54c-5vlsm" event={"ID":"1600d509-9b23-4da1-bd9b-db778a5d94d2","Type":"ContainerDied","Data":"07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04"} Jul 02 17:02:02.862272 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.861944 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566fb9f54c-5vlsm" event={"ID":"1600d509-9b23-4da1-bd9b-db778a5d94d2","Type":"ContainerDied","Data":"f7e4a83543836b6c416c91070c736804bf746e74e0699d8844155e29c66f7101"} Jul 02 17:02:02.862272 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.861964 2582 scope.go:117] "RemoveContainer" containerID="07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04" Jul 02 17:02:02.870846 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.870829 2582 scope.go:117] "RemoveContainer" containerID="07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04" Jul 02 17:02:02.871105 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:02:02.871089 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04\": container with ID starting with 07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04 not found: ID does not exist" containerID="07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04" Jul 02 17:02:02.871164 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.871115 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04"} err="failed to get container status \"07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04\": rpc error: code = NotFound desc = could not find container \"07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04\": container with ID starting with 07d8a45920d36061ae0085b47b0ef762a9321c42066c01a54345340ae2dc7f04 not found: ID does not exist" Jul 02 17:02:02.884670 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.884645 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566fb9f54c-5vlsm"] Jul 02 17:02:02.887210 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:02.887189 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-566fb9f54c-5vlsm"] Jul 02 17:02:03.617828 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:03.617786 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1600d509-9b23-4da1-bd9b-db778a5d94d2" path="/var/lib/kubelet/pods/1600d509-9b23-4da1-bd9b-db778a5d94d2/volumes" Jul 02 17:02:30.885629 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:30.885593 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:02:30.887606 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:30.887585 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:02:30.892151 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:30.892123 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 17:02:54.994826 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:54.994789 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb"] Jul 02 17:02:54.997117 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:54.995113 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1600d509-9b23-4da1-bd9b-db778a5d94d2" containerName="console" Jul 02 17:02:54.997117 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:54.995124 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1600d509-9b23-4da1-bd9b-db778a5d94d2" containerName="console" Jul 02 17:02:54.997117 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:54.995184 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1600d509-9b23-4da1-bd9b-db778a5d94d2" containerName="console" Jul 02 17:02:54.998041 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:54.998027 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb" Jul 02 17:02:55.001208 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.001182 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-f84g8\"" Jul 02 17:02:55.001453 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.001438 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 17:02:55.002368 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.002353 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 17:02:55.006680 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.006656 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb"] Jul 02 17:02:55.134569 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.134533 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kqtz\" (UniqueName: \"kubernetes.io/projected/eedb44d4-204a-4985-ba11-fe0366f2022e-kube-api-access-6kqtz\") pod \"cert-manager-cainjector-559cdd8c87-tm6sb\" (UID: \"eedb44d4-204a-4985-ba11-fe0366f2022e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb" Jul 02 17:02:55.134569 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.134575 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eedb44d4-204a-4985-ba11-fe0366f2022e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tm6sb\" (UID: \"eedb44d4-204a-4985-ba11-fe0366f2022e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb" Jul 02 17:02:55.235631 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.235598 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kqtz\" (UniqueName: \"kubernetes.io/projected/eedb44d4-204a-4985-ba11-fe0366f2022e-kube-api-access-6kqtz\") pod \"cert-manager-cainjector-559cdd8c87-tm6sb\" (UID: \"eedb44d4-204a-4985-ba11-fe0366f2022e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb" Jul 02 17:02:55.235631 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.235635 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eedb44d4-204a-4985-ba11-fe0366f2022e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tm6sb\" (UID: \"eedb44d4-204a-4985-ba11-fe0366f2022e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb" Jul 02 17:02:55.245805 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.245738 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eedb44d4-204a-4985-ba11-fe0366f2022e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tm6sb\" (UID: \"eedb44d4-204a-4985-ba11-fe0366f2022e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb" Jul 02 17:02:55.245909 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.245850 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kqtz\" (UniqueName: \"kubernetes.io/projected/eedb44d4-204a-4985-ba11-fe0366f2022e-kube-api-access-6kqtz\") pod \"cert-manager-cainjector-559cdd8c87-tm6sb\" (UID: \"eedb44d4-204a-4985-ba11-fe0366f2022e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb" Jul 02 17:02:55.319851 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.319803 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb" Jul 02 17:02:55.451061 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.451039 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb"] Jul 02 17:02:55.453309 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:02:55.453259 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeedb44d4_204a_4985_ba11_fe0366f2022e.slice/crio-47c73f151d1e70686ddb376490309638751a7d40a193eb89f96b8ade4e6cdd43 WatchSource:0}: Error finding container 47c73f151d1e70686ddb376490309638751a7d40a193eb89f96b8ade4e6cdd43: Status 404 returned error can't find the container with id 47c73f151d1e70686ddb376490309638751a7d40a193eb89f96b8ade4e6cdd43 Jul 02 17:02:55.455252 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:55.455235 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 17:02:56.069251 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:02:56.069214 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb" event={"ID":"eedb44d4-204a-4985-ba11-fe0366f2022e","Type":"ContainerStarted","Data":"47c73f151d1e70686ddb376490309638751a7d40a193eb89f96b8ade4e6cdd43"} Jul 02 17:03:00.092588 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:00.092555 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb" event={"ID":"eedb44d4-204a-4985-ba11-fe0366f2022e","Type":"ContainerStarted","Data":"535127391e37a7586d204c20e79c13da280f97d60fa0c989e02960427789c832"} Jul 02 17:03:00.110465 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:00.110412 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tm6sb" podStartSLOduration=2.256855797 podStartE2EDuration="6.110398267s" totalImagesPullingTime="3.85354247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:00.10909387 +0000 UTC m=+330.662936295" watchObservedRunningTime="2026-07-02 17:03:00.110398267 +0000 UTC m=+330.664240688" Jul 02 17:03:04.630889 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:04.630853 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nglvx"] Jul 02 17:03:04.634315 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:04.634296 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nglvx" Jul 02 17:03:04.636718 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:04.636696 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6hbb6\"" Jul 02 17:03:04.643913 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:04.643891 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nglvx"] Jul 02 17:03:04.725140 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:04.725103 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzxm4\" (UniqueName: \"kubernetes.io/projected/39f4a361-524a-4072-9993-484982db47d3-kube-api-access-fzxm4\") pod \"cert-manager-55b4d954d5-nglvx\" (UID: \"39f4a361-524a-4072-9993-484982db47d3\") " pod="cert-manager/cert-manager-55b4d954d5-nglvx" Jul 02 17:03:04.725345 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:04.725170 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39f4a361-524a-4072-9993-484982db47d3-bound-sa-token\") pod \"cert-manager-55b4d954d5-nglvx\" (UID: \"39f4a361-524a-4072-9993-484982db47d3\") " pod="cert-manager/cert-manager-55b4d954d5-nglvx" Jul 02 17:03:04.826636 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:04.826601 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39f4a361-524a-4072-9993-484982db47d3-bound-sa-token\") pod \"cert-manager-55b4d954d5-nglvx\" (UID: \"39f4a361-524a-4072-9993-484982db47d3\") " pod="cert-manager/cert-manager-55b4d954d5-nglvx" Jul 02 17:03:04.826809 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:04.826670 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxm4\" (UniqueName: \"kubernetes.io/projected/39f4a361-524a-4072-9993-484982db47d3-kube-api-access-fzxm4\") pod \"cert-manager-55b4d954d5-nglvx\" (UID: \"39f4a361-524a-4072-9993-484982db47d3\") " pod="cert-manager/cert-manager-55b4d954d5-nglvx" Jul 02 17:03:04.835658 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:04.835626 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39f4a361-524a-4072-9993-484982db47d3-bound-sa-token\") pod \"cert-manager-55b4d954d5-nglvx\" (UID: \"39f4a361-524a-4072-9993-484982db47d3\") " pod="cert-manager/cert-manager-55b4d954d5-nglvx" Jul 02 17:03:04.835919 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:04.835903 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzxm4\" (UniqueName: \"kubernetes.io/projected/39f4a361-524a-4072-9993-484982db47d3-kube-api-access-fzxm4\") pod \"cert-manager-55b4d954d5-nglvx\" (UID: \"39f4a361-524a-4072-9993-484982db47d3\") " pod="cert-manager/cert-manager-55b4d954d5-nglvx" Jul 02 17:03:04.944006 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:04.943918 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nglvx" Jul 02 17:03:05.070180 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:05.070148 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nglvx"] Jul 02 17:03:05.073031 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:03:05.073006 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39f4a361_524a_4072_9993_484982db47d3.slice/crio-f55a24f91f06322b03c0c17d5fb41e2c2397ad6c7c817d27876be8d284636a0b WatchSource:0}: Error finding container f55a24f91f06322b03c0c17d5fb41e2c2397ad6c7c817d27876be8d284636a0b: Status 404 returned error can't find the container with id f55a24f91f06322b03c0c17d5fb41e2c2397ad6c7c817d27876be8d284636a0b Jul 02 17:03:05.116810 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:05.116777 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nglvx" event={"ID":"39f4a361-524a-4072-9993-484982db47d3","Type":"ContainerStarted","Data":"f55a24f91f06322b03c0c17d5fb41e2c2397ad6c7c817d27876be8d284636a0b"} Jul 02 17:03:06.122602 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:06.122567 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nglvx" event={"ID":"39f4a361-524a-4072-9993-484982db47d3","Type":"ContainerStarted","Data":"b8dc6d42efb96f2e61879c2dc53284d70f17000cd4f6916c3998928c46e5a9f0"} Jul 02 17:03:06.139475 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:06.139429 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nglvx" podStartSLOduration=2.139414794 podStartE2EDuration="2.139414794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:06.137736214 +0000 UTC m=+336.691578636" watchObservedRunningTime="2026-07-02 17:03:06.139414794 +0000 UTC m=+336.693257215" Jul 02 17:03:26.627702 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.627630 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx"] Jul 02 17:03:26.631030 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.631015 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.633587 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.633566 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 17:03:26.633760 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.633739 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 17:03:26.633826 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.633797 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2dzb5\"" Jul 02 17:03:26.633872 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.633845 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 17:03:26.634036 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.634014 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 17:03:26.646851 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.646826 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx"] Jul 02 17:03:26.717313 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.716096 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-manifests\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.717313 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.716228 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.717313 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.716312 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-tmp\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.717313 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.716393 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7kw6\" (UniqueName: \"kubernetes.io/projected/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-kube-api-access-v7kw6\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.717313 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.716521 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.817846 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.817796 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-manifests\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.817846 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.817865 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.818129 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.817892 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-tmp\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.818129 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.817925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7kw6\" (UniqueName: \"kubernetes.io/projected/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-kube-api-access-v7kw6\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.818129 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.817980 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.818324 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.818228 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-manifests\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.820356 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.820332 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-tmp\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.820464 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.820388 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.820464 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.820441 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.826329 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.826306 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7kw6\" (UniqueName: \"kubernetes.io/projected/db396e0b-a4ce-4d4a-91f4-d34050a4dc5c-kube-api-access-v7kw6\") pod \"opendatahub-operator-controller-manager-7758cbfb47-688zx\" (UID: \"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:26.943161 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:26.943067 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:27.082462 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:27.082427 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx"] Jul 02 17:03:27.085786 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:03:27.085756 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb396e0b_a4ce_4d4a_91f4_d34050a4dc5c.slice/crio-8cc1dc499a3bd0507a29fa2fe3265fcf439f9be439209da00e9099404568254a WatchSource:0}: Error finding container 8cc1dc499a3bd0507a29fa2fe3265fcf439f9be439209da00e9099404568254a: Status 404 returned error can't find the container with id 8cc1dc499a3bd0507a29fa2fe3265fcf439f9be439209da00e9099404568254a Jul 02 17:03:27.215423 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:27.215333 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" event={"ID":"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c","Type":"ContainerStarted","Data":"8cc1dc499a3bd0507a29fa2fe3265fcf439f9be439209da00e9099404568254a"} Jul 02 17:03:31.236341 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:31.236274 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" event={"ID":"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c","Type":"ContainerStarted","Data":"c63bc6e3c2cffa11c12c4f841a4f9cb527d1cd6555f719e8656708cf0369ed5d"} Jul 02 17:03:32.242401 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:32.242370 2582 generic.go:356] "Generic (PLEG): container finished" podID="db396e0b-a4ce-4d4a-91f4-d34050a4dc5c" containerID="c63bc6e3c2cffa11c12c4f841a4f9cb527d1cd6555f719e8656708cf0369ed5d" exitCode=0 Jul 02 17:03:32.242751 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:32.242451 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" event={"ID":"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c","Type":"ContainerDied","Data":"c63bc6e3c2cffa11c12c4f841a4f9cb527d1cd6555f719e8656708cf0369ed5d"} Jul 02 17:03:33.249033 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:33.248997 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" event={"ID":"db396e0b-a4ce-4d4a-91f4-d34050a4dc5c","Type":"ContainerStarted","Data":"8e616c2d8c04f19e53bf65afbca52d1aff5070cb74c4d883773d928841e5b7a9"} Jul 02 17:03:33.249431 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:33.249082 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:33.271861 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:33.271794 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" podStartSLOduration=2.29215589 podStartE2EDuration="7.2717784s" totalImagesPullingTime="3.929206199s" totalInitContainerRuntime="1.050416311s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:33.270376037 +0000 UTC m=+363.824218458" watchObservedRunningTime="2026-07-02 17:03:33.2717784 +0000 UTC m=+363.825620821" Jul 02 17:03:44.256006 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:44.255973 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-688zx" Jul 02 17:03:56.073499 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.073465 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc"] Jul 02 17:03:56.075788 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.075773 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.078814 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.078790 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 17:03:56.078979 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.078969 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pm8cc\"" Jul 02 17:03:56.079729 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.079710 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 17:03:56.079959 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.079941 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 17:03:56.080053 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.080037 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 17:03:56.080442 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.080424 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 17:03:56.093273 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.093252 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-manager-config\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.093418 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.093311 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-metrics-cert\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.093418 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.093335 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-cert\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.093418 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.093369 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgrf7\" (UniqueName: \"kubernetes.io/projected/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-kube-api-access-rgrf7\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.098401 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.098382 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc"] Jul 02 17:03:56.194108 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.194075 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-metrics-cert\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.194265 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.194125 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-cert\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.194265 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.194181 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgrf7\" (UniqueName: \"kubernetes.io/projected/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-kube-api-access-rgrf7\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.194265 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.194225 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-manager-config\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.194872 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.194851 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-manager-config\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.196585 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.196563 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-metrics-cert\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.196702 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.196682 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-cert\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.244937 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.244905 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgrf7\" (UniqueName: \"kubernetes.io/projected/df0dacc7-c491-4d49-ab7b-2ba5ae095f23-kube-api-access-rgrf7\") pod \"lws-controller-manager-79ccbb9b6f-wn6xc\" (UID: \"df0dacc7-c491-4d49-ab7b-2ba5ae095f23\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.385741 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.385657 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:56.524134 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:56.524107 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc"] Jul 02 17:03:56.527572 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:03:56.527546 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0dacc7_c491_4d49_ab7b_2ba5ae095f23.slice/crio-d0dfb55229ff4b8e20ab93cf5982969838c9487193309c996f1c112aabaf0c49 WatchSource:0}: Error finding container d0dfb55229ff4b8e20ab93cf5982969838c9487193309c996f1c112aabaf0c49: Status 404 returned error can't find the container with id d0dfb55229ff4b8e20ab93cf5982969838c9487193309c996f1c112aabaf0c49 Jul 02 17:03:57.291975 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.291937 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w"] Jul 02 17:03:57.294672 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.294610 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.299169 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.299147 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 17:03:57.303885 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.303421 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgrfs\" (UniqueName: \"kubernetes.io/projected/d6340867-34af-4d5f-b026-c33335ab3465-kube-api-access-kgrfs\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.303885 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.303520 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6340867-34af-4d5f-b026-c33335ab3465-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.303885 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.303571 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6340867-34af-4d5f-b026-c33335ab3465-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.303885 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.303600 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d6340867-34af-4d5f-b026-c33335ab3465-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.303885 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.303644 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6340867-34af-4d5f-b026-c33335ab3465-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.303885 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.303676 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d6340867-34af-4d5f-b026-c33335ab3465-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.303885 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.303703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d6340867-34af-4d5f-b026-c33335ab3465-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.305500 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.305247 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 17:03:57.305500 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.305299 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 17:03:57.315224 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.315198 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 17:03:57.318940 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.318918 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6wc4g\"" Jul 02 17:03:57.320075 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.320033 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 17:03:57.343052 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.343033 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 17:03:57.361003 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.360975 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" event={"ID":"df0dacc7-c491-4d49-ab7b-2ba5ae095f23","Type":"ContainerStarted","Data":"d0dfb55229ff4b8e20ab93cf5982969838c9487193309c996f1c112aabaf0c49"} Jul 02 17:03:57.398920 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.398887 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w"] Jul 02 17:03:57.404716 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.404679 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6340867-34af-4d5f-b026-c33335ab3465-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.404861 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.404747 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6340867-34af-4d5f-b026-c33335ab3465-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.404861 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.404778 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d6340867-34af-4d5f-b026-c33335ab3465-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.404861 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.404805 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6340867-34af-4d5f-b026-c33335ab3465-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.404861 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.404826 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d6340867-34af-4d5f-b026-c33335ab3465-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.404861 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.404849 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d6340867-34af-4d5f-b026-c33335ab3465-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.405132 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.404891 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgrfs\" (UniqueName: \"kubernetes.io/projected/d6340867-34af-4d5f-b026-c33335ab3465-kube-api-access-kgrfs\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.406181 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.406135 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d6340867-34af-4d5f-b026-c33335ab3465-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.408180 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.408155 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d6340867-34af-4d5f-b026-c33335ab3465-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.408874 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.408852 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6340867-34af-4d5f-b026-c33335ab3465-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.409138 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.409115 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6340867-34af-4d5f-b026-c33335ab3465-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.409582 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.409560 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d6340867-34af-4d5f-b026-c33335ab3465-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.417008 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.416780 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgrfs\" (UniqueName: \"kubernetes.io/projected/d6340867-34af-4d5f-b026-c33335ab3465-kube-api-access-kgrfs\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.427169 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.427147 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6340867-34af-4d5f-b026-c33335ab3465-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4gn4w\" (UID: \"d6340867-34af-4d5f-b026-c33335ab3465\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:57.607598 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:57.607564 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:03:58.797724 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:58.797701 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w"] Jul 02 17:03:58.798507 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:03:58.798485 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6340867_34af_4d5f_b026_c33335ab3465.slice/crio-69087c8eaf041f05b72f692a5c9258065e97f1ae4ebd8f661058158eef924c8f WatchSource:0}: Error finding container 69087c8eaf041f05b72f692a5c9258065e97f1ae4ebd8f661058158eef924c8f: Status 404 returned error can't find the container with id 69087c8eaf041f05b72f692a5c9258065e97f1ae4ebd8f661058158eef924c8f Jul 02 17:03:59.373461 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:59.373426 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" event={"ID":"d6340867-34af-4d5f-b026-c33335ab3465","Type":"ContainerStarted","Data":"69087c8eaf041f05b72f692a5c9258065e97f1ae4ebd8f661058158eef924c8f"} Jul 02 17:03:59.375238 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:59.375191 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" event={"ID":"df0dacc7-c491-4d49-ab7b-2ba5ae095f23","Type":"ContainerStarted","Data":"4c5e00637b4ec2b82e05df67ad8b77b6d0dfc04a718c84f79dc8552dd03a6f9f"} Jul 02 17:03:59.375468 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:59.375359 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:03:59.403531 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:03:59.403486 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" podStartSLOduration=1.2511998260000001 podStartE2EDuration="3.403472099s" totalImagesPullingTime="2.152272273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:59.402857264 +0000 UTC m=+389.956699685" watchObservedRunningTime="2026-07-02 17:03:59.403472099 +0000 UTC m=+389.957314520" Jul 02 17:04:01.540870 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:04:01.540829 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 02 17:04:01.541129 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:04:01.540902 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 02 17:04:02.391829 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:04:02.391794 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" event={"ID":"d6340867-34af-4d5f-b026-c33335ab3465","Type":"ContainerStarted","Data":"875ec2b8030b9edba6afe616730d96690be0d9b034236d55b0da1b78d6d0215a"} Jul 02 17:04:02.391999 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:04:02.391971 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:04:02.393525 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:04:02.393495 2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-4gn4w container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 17:04:02.393638 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:04:02.393547 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" podUID="d6340867-34af-4d5f-b026-c33335ab3465" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 17:04:02.437428 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:04:02.437373 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" podStartSLOduration=2.697355794 podStartE2EDuration="5.437354806s" totalImagesPullingTime="2.739999012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:04:02.436525224 +0000 UTC m=+392.990367645" watchObservedRunningTime="2026-07-02 17:04:02.437354806 +0000 UTC m=+392.991197227" Jul 02 17:04:03.397105 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:04:03.397068 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4gn4w" Jul 02 17:04:10.382409 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:04:10.382378 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-wn6xc" Jul 02 17:05:15.340566 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.340532 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fdcfbf94f-5rzlk"] Jul 02 17:05:15.343168 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.343151 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.364111 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.364087 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdcfbf94f-5rzlk"] Jul 02 17:05:15.476077 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.476045 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-trusted-ca-bundle\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.476257 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.476095 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21680c9c-e627-404a-adde-91b312333273-console-serving-cert\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.476257 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.476119 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-service-ca\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.476257 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.476242 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21680c9c-e627-404a-adde-91b312333273-console-oauth-config\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.476396 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.476268 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-console-config\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.476396 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.476314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdcr6\" (UniqueName: \"kubernetes.io/projected/21680c9c-e627-404a-adde-91b312333273-kube-api-access-pdcr6\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.476396 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.476340 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-oauth-serving-cert\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.577021 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.576983 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21680c9c-e627-404a-adde-91b312333273-console-oauth-config\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.577213 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.577046 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-console-config\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.577213 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.577101 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdcr6\" (UniqueName: \"kubernetes.io/projected/21680c9c-e627-404a-adde-91b312333273-kube-api-access-pdcr6\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.577213 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.577151 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-oauth-serving-cert\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.577432 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.577246 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-trusted-ca-bundle\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.577432 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.577274 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21680c9c-e627-404a-adde-91b312333273-console-serving-cert\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.577432 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.577332 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-service-ca\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.578172 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.578109 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-oauth-serving-cert\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.578172 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.578116 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-console-config\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.578577 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.578553 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-service-ca\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.578829 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.578811 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21680c9c-e627-404a-adde-91b312333273-trusted-ca-bundle\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.579818 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.579793 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21680c9c-e627-404a-adde-91b312333273-console-serving-cert\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.579903 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.579888 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21680c9c-e627-404a-adde-91b312333273-console-oauth-config\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.595828 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.595772 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdcr6\" (UniqueName: \"kubernetes.io/projected/21680c9c-e627-404a-adde-91b312333273-kube-api-access-pdcr6\") pod \"console-6fdcfbf94f-5rzlk\" (UID: \"21680c9c-e627-404a-adde-91b312333273\") " pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.652075 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.652039 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:15.841155 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:05:15.841118 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21680c9c_e627_404a_adde_91b312333273.slice/crio-b81f491f64d70a00a605cac750d95968cfc67776fe5d7c09245bb35033539450 WatchSource:0}: Error finding container b81f491f64d70a00a605cac750d95968cfc67776fe5d7c09245bb35033539450: Status 404 returned error can't find the container with id b81f491f64d70a00a605cac750d95968cfc67776fe5d7c09245bb35033539450 Jul 02 17:05:15.847546 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:15.846173 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdcfbf94f-5rzlk"] Jul 02 17:05:16.721138 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:16.721102 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdcfbf94f-5rzlk" event={"ID":"21680c9c-e627-404a-adde-91b312333273","Type":"ContainerStarted","Data":"29c217fbd16ff19ef1ab9e27a2a87419ecfa8c9841b7792a1664802d3dfb630b"} Jul 02 17:05:16.721524 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:16.721158 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdcfbf94f-5rzlk" event={"ID":"21680c9c-e627-404a-adde-91b312333273","Type":"ContainerStarted","Data":"b81f491f64d70a00a605cac750d95968cfc67776fe5d7c09245bb35033539450"} Jul 02 17:05:16.743905 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:16.743858 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fdcfbf94f-5rzlk" podStartSLOduration=1.743843324 podStartE2EDuration="1.743843324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:05:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:05:16.74169777 +0000 UTC m=+467.295540216" watchObservedRunningTime="2026-07-02 17:05:16.743843324 +0000 UTC m=+467.297685744" Jul 02 17:05:25.652844 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:25.652810 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:25.653236 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:25.652866 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:25.657529 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:25.657506 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:25.768501 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:25.768477 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fdcfbf94f-5rzlk" Jul 02 17:05:25.893788 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:25.893744 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6496694d4b-bwcxc"] Jul 02 17:05:38.365046 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.364995 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf"] Jul 02 17:05:38.367487 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.367467 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:05:38.373118 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.373096 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 17:05:38.373761 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.373703 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p8crq\"" Jul 02 17:05:38.373836 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.373776 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 17:05:38.387919 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.387897 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ff2bf84-4811-483a-b647-42b2b06805b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cb5gf\" (UID: \"5ff2bf84-4811-483a-b647-42b2b06805b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:05:38.388190 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.387941 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qjnx\" (UniqueName: \"kubernetes.io/projected/5ff2bf84-4811-483a-b647-42b2b06805b2-kube-api-access-6qjnx\") pod \"kuadrant-operator-controller-manager-86878c769f-cb5gf\" (UID: \"5ff2bf84-4811-483a-b647-42b2b06805b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:05:38.402026 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.401999 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf"] Jul 02 17:05:38.488381 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.488352 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qjnx\" (UniqueName: \"kubernetes.io/projected/5ff2bf84-4811-483a-b647-42b2b06805b2-kube-api-access-6qjnx\") pod \"kuadrant-operator-controller-manager-86878c769f-cb5gf\" (UID: \"5ff2bf84-4811-483a-b647-42b2b06805b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:05:38.488526 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.488462 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ff2bf84-4811-483a-b647-42b2b06805b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cb5gf\" (UID: \"5ff2bf84-4811-483a-b647-42b2b06805b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:05:38.488822 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.488803 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ff2bf84-4811-483a-b647-42b2b06805b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cb5gf\" (UID: \"5ff2bf84-4811-483a-b647-42b2b06805b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:05:38.509970 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.509943 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qjnx\" (UniqueName: \"kubernetes.io/projected/5ff2bf84-4811-483a-b647-42b2b06805b2-kube-api-access-6qjnx\") pod \"kuadrant-operator-controller-manager-86878c769f-cb5gf\" (UID: \"5ff2bf84-4811-483a-b647-42b2b06805b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:05:38.677931 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.677835 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:05:38.820254 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:38.820230 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf"] Jul 02 17:05:38.822082 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:05:38.822054 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff2bf84_4811_483a_b647_42b2b06805b2.slice/crio-7b16c3cf367705a6d321ba9f5353fce4d5f66db726319e30ff19ed6cc5ddaf3c WatchSource:0}: Error finding container 7b16c3cf367705a6d321ba9f5353fce4d5f66db726319e30ff19ed6cc5ddaf3c: Status 404 returned error can't find the container with id 7b16c3cf367705a6d321ba9f5353fce4d5f66db726319e30ff19ed6cc5ddaf3c Jul 02 17:05:39.832066 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:39.832023 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" event={"ID":"5ff2bf84-4811-483a-b647-42b2b06805b2","Type":"ContainerStarted","Data":"7b16c3cf367705a6d321ba9f5353fce4d5f66db726319e30ff19ed6cc5ddaf3c"} Jul 02 17:05:42.849586 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:42.849547 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" event={"ID":"5ff2bf84-4811-483a-b647-42b2b06805b2","Type":"ContainerStarted","Data":"4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9"} Jul 02 17:05:42.850097 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:42.849624 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:05:42.894513 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:42.894466 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" podStartSLOduration=1.262918374 podStartE2EDuration="4.894451667s" totalImagesPullingTime="3.631533293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:05:42.892787563 +0000 UTC m=+493.446629987" watchObservedRunningTime="2026-07-02 17:05:42.894451667 +0000 UTC m=+493.448294088" Jul 02 17:05:50.913682 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:50.913633 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6496694d4b-bwcxc" podUID="41831afe-151f-4e2b-a874-85459e1b9d5d" containerName="console" containerID="cri-o://0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085" gracePeriod=15 Jul 02 17:05:51.150527 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.150502 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:05:51.215586 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.215455 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-console-config\") pod \"41831afe-151f-4e2b-a874-85459e1b9d5d\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " Jul 02 17:05:51.215737 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.215595 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-oauth-config\") pod \"41831afe-151f-4e2b-a874-85459e1b9d5d\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " Jul 02 17:05:51.215737 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.215626 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-service-ca\") pod \"41831afe-151f-4e2b-a874-85459e1b9d5d\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " Jul 02 17:05:51.215737 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.215645 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-serving-cert\") pod \"41831afe-151f-4e2b-a874-85459e1b9d5d\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " Jul 02 17:05:51.215737 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.215665 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-trusted-ca-bundle\") pod \"41831afe-151f-4e2b-a874-85459e1b9d5d\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " Jul 02 17:05:51.215737 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.215703 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqmjc\" (UniqueName: \"kubernetes.io/projected/41831afe-151f-4e2b-a874-85459e1b9d5d-kube-api-access-cqmjc\") pod \"41831afe-151f-4e2b-a874-85459e1b9d5d\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " Jul 02 17:05:51.215737 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.215717 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-console-config" (OuterVolumeSpecName: "console-config") pod "41831afe-151f-4e2b-a874-85459e1b9d5d" (UID: "41831afe-151f-4e2b-a874-85459e1b9d5d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:05:51.216053 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.215741 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-oauth-serving-cert\") pod \"41831afe-151f-4e2b-a874-85459e1b9d5d\" (UID: \"41831afe-151f-4e2b-a874-85459e1b9d5d\") " Jul 02 17:05:51.216119 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.216080 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-console-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:05:51.216119 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.216105 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-service-ca" (OuterVolumeSpecName: "service-ca") pod "41831afe-151f-4e2b-a874-85459e1b9d5d" (UID: "41831afe-151f-4e2b-a874-85459e1b9d5d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:05:51.216226 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.216199 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "41831afe-151f-4e2b-a874-85459e1b9d5d" (UID: "41831afe-151f-4e2b-a874-85459e1b9d5d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:05:51.216314 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.216239 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "41831afe-151f-4e2b-a874-85459e1b9d5d" (UID: "41831afe-151f-4e2b-a874-85459e1b9d5d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:05:51.217841 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.217816 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "41831afe-151f-4e2b-a874-85459e1b9d5d" (UID: "41831afe-151f-4e2b-a874-85459e1b9d5d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:05:51.217938 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.217880 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41831afe-151f-4e2b-a874-85459e1b9d5d-kube-api-access-cqmjc" (OuterVolumeSpecName: "kube-api-access-cqmjc") pod "41831afe-151f-4e2b-a874-85459e1b9d5d" (UID: "41831afe-151f-4e2b-a874-85459e1b9d5d"). InnerVolumeSpecName "kube-api-access-cqmjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:05:51.217938 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.217875 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "41831afe-151f-4e2b-a874-85459e1b9d5d" (UID: "41831afe-151f-4e2b-a874-85459e1b9d5d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:05:51.317380 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.317357 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqmjc\" (UniqueName: \"kubernetes.io/projected/41831afe-151f-4e2b-a874-85459e1b9d5d-kube-api-access-cqmjc\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:05:51.317380 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.317378 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-oauth-serving-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:05:51.317536 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.317387 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-oauth-config\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:05:51.317536 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.317397 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:05:51.317536 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.317405 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41831afe-151f-4e2b-a874-85459e1b9d5d-console-serving-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:05:51.317536 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.317413 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41831afe-151f-4e2b-a874-85459e1b9d5d-trusted-ca-bundle\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:05:51.889771 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.889683 2582 generic.go:356] "Generic (PLEG): container finished" podID="41831afe-151f-4e2b-a874-85459e1b9d5d" containerID="0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085" exitCode=0 Jul 02 17:05:51.889771 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.889725 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496694d4b-bwcxc" Jul 02 17:05:51.889948 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.889765 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496694d4b-bwcxc" event={"ID":"41831afe-151f-4e2b-a874-85459e1b9d5d","Type":"ContainerDied","Data":"0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085"} Jul 02 17:05:51.889948 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.889811 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496694d4b-bwcxc" event={"ID":"41831afe-151f-4e2b-a874-85459e1b9d5d","Type":"ContainerDied","Data":"ee7bc7079a16e94e7f59f2c5002b550813f8345d0f98409af8f55c08d1113f95"} Jul 02 17:05:51.889948 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.889834 2582 scope.go:117] "RemoveContainer" containerID="0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085" Jul 02 17:05:51.898142 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.898128 2582 scope.go:117] "RemoveContainer" containerID="0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085" Jul 02 17:05:51.898440 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:05:51.898420 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085\": container with ID starting with 0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085 not found: ID does not exist" containerID="0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085" Jul 02 17:05:51.898491 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.898449 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085"} err="failed to get container status \"0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085\": rpc error: code = NotFound desc = could not find container \"0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085\": container with ID starting with 0c05dfe4b79277d65042b0644dca9a4acbc8156da99e2cdad3dd3d25099d9085 not found: ID does not exist" Jul 02 17:05:51.907291 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.907246 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6496694d4b-bwcxc"] Jul 02 17:05:51.912449 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:51.912429 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6496694d4b-bwcxc"] Jul 02 17:05:53.618192 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:53.618156 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41831afe-151f-4e2b-a874-85459e1b9d5d" path="/var/lib/kubelet/pods/41831afe-151f-4e2b-a874-85459e1b9d5d/volumes" Jul 02 17:05:53.856853 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:05:53.856823 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:06:36.944352 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:36.944319 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-t4hpd"] Jul 02 17:06:36.944938 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:36.944900 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41831afe-151f-4e2b-a874-85459e1b9d5d" containerName="console" Jul 02 17:06:36.944938 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:36.944921 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41831afe-151f-4e2b-a874-85459e1b9d5d" containerName="console" Jul 02 17:06:36.945066 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:36.945011 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="41831afe-151f-4e2b-a874-85459e1b9d5d" containerName="console" Jul 02 17:06:36.947710 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:36.947682 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-t4hpd" Jul 02 17:06:36.950336 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:36.950310 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 02 17:06:36.950463 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:36.950365 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kkw7c\"" Jul 02 17:06:36.958193 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:36.958171 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-t4hpd"] Jul 02 17:06:37.036826 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:37.036796 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9ww2\" (UniqueName: \"kubernetes.io/projected/38b29694-37b6-4d4e-8171-e050404ac4d0-kube-api-access-g9ww2\") pod \"postgres-69fb4594cf-t4hpd\" (UID: \"38b29694-37b6-4d4e-8171-e050404ac4d0\") " pod="opendatahub/postgres-69fb4594cf-t4hpd" Jul 02 17:06:37.037000 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:37.036859 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/38b29694-37b6-4d4e-8171-e050404ac4d0-data\") pod \"postgres-69fb4594cf-t4hpd\" (UID: \"38b29694-37b6-4d4e-8171-e050404ac4d0\") " pod="opendatahub/postgres-69fb4594cf-t4hpd" Jul 02 17:06:37.138336 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:37.138300 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/38b29694-37b6-4d4e-8171-e050404ac4d0-data\") pod \"postgres-69fb4594cf-t4hpd\" (UID: \"38b29694-37b6-4d4e-8171-e050404ac4d0\") " pod="opendatahub/postgres-69fb4594cf-t4hpd" Jul 02 17:06:37.138508 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:37.138390 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ww2\" (UniqueName: \"kubernetes.io/projected/38b29694-37b6-4d4e-8171-e050404ac4d0-kube-api-access-g9ww2\") pod \"postgres-69fb4594cf-t4hpd\" (UID: \"38b29694-37b6-4d4e-8171-e050404ac4d0\") " pod="opendatahub/postgres-69fb4594cf-t4hpd" Jul 02 17:06:37.138709 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:37.138690 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/38b29694-37b6-4d4e-8171-e050404ac4d0-data\") pod \"postgres-69fb4594cf-t4hpd\" (UID: \"38b29694-37b6-4d4e-8171-e050404ac4d0\") " pod="opendatahub/postgres-69fb4594cf-t4hpd" Jul 02 17:06:37.148537 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:37.148517 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9ww2\" (UniqueName: \"kubernetes.io/projected/38b29694-37b6-4d4e-8171-e050404ac4d0-kube-api-access-g9ww2\") pod \"postgres-69fb4594cf-t4hpd\" (UID: \"38b29694-37b6-4d4e-8171-e050404ac4d0\") " pod="opendatahub/postgres-69fb4594cf-t4hpd" Jul 02 17:06:37.261744 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:37.261659 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-t4hpd" Jul 02 17:06:37.599765 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:37.599741 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-t4hpd"] Jul 02 17:06:37.602187 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:06:37.602160 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b29694_37b6_4d4e_8171_e050404ac4d0.slice/crio-9d30b2a4d98debca8e011fd333d0d89aff7efe1f0e99b704174bf1c345f6bd51 WatchSource:0}: Error finding container 9d30b2a4d98debca8e011fd333d0d89aff7efe1f0e99b704174bf1c345f6bd51: Status 404 returned error can't find the container with id 9d30b2a4d98debca8e011fd333d0d89aff7efe1f0e99b704174bf1c345f6bd51 Jul 02 17:06:38.109442 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:38.109408 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-t4hpd" event={"ID":"38b29694-37b6-4d4e-8171-e050404ac4d0","Type":"ContainerStarted","Data":"9d30b2a4d98debca8e011fd333d0d89aff7efe1f0e99b704174bf1c345f6bd51"} Jul 02 17:06:43.137998 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:43.137959 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-t4hpd" event={"ID":"38b29694-37b6-4d4e-8171-e050404ac4d0","Type":"ContainerStarted","Data":"22e2f3792f3660f6d4b9b249f50a77d6c309869df42a3ebb6160bb9a298d503b"} Jul 02 17:06:43.138415 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:43.138045 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-t4hpd" Jul 02 17:06:43.156884 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:43.156836 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-t4hpd" podStartSLOduration=2.277014644 podStartE2EDuration="7.156819943s" totalImagesPullingTime="4.879805299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:06:43.156212387 +0000 UTC m=+553.710054809" watchObservedRunningTime="2026-07-02 17:06:43.156819943 +0000 UTC m=+553.710662363" Jul 02 17:06:49.172258 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:06:49.172224 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-t4hpd" Jul 02 17:07:30.915574 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:30.915546 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:07:30.916103 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:30.916082 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:07:51.423113 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.423079 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c4db889fc-gflnd"] Jul 02 17:07:51.426507 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.426490 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:07:51.432832 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.432627 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 17:07:51.433346 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.433193 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p5ttx\"" Jul 02 17:07:51.433346 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.433193 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 17:07:51.445386 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.445361 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4db889fc-gflnd"] Jul 02 17:07:51.517059 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.517023 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fe61926-4ef4-4f0f-9b57-30592ab815d1-webhook-cert\") pod \"maas-controller-6c4db889fc-gflnd\" (UID: \"5fe61926-4ef4-4f0f-9b57-30592ab815d1\") " pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:07:51.517059 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.517062 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx28s\" (UniqueName: \"kubernetes.io/projected/5fe61926-4ef4-4f0f-9b57-30592ab815d1-kube-api-access-xx28s\") pod \"maas-controller-6c4db889fc-gflnd\" (UID: \"5fe61926-4ef4-4f0f-9b57-30592ab815d1\") " pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:07:51.617589 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.617505 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fe61926-4ef4-4f0f-9b57-30592ab815d1-webhook-cert\") pod \"maas-controller-6c4db889fc-gflnd\" (UID: \"5fe61926-4ef4-4f0f-9b57-30592ab815d1\") " pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:07:51.617589 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.617537 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx28s\" (UniqueName: \"kubernetes.io/projected/5fe61926-4ef4-4f0f-9b57-30592ab815d1-kube-api-access-xx28s\") pod \"maas-controller-6c4db889fc-gflnd\" (UID: \"5fe61926-4ef4-4f0f-9b57-30592ab815d1\") " pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:07:51.617822 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:07:51.617646 2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 02 17:07:51.617822 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:07:51.617712 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe61926-4ef4-4f0f-9b57-30592ab815d1-webhook-cert podName:5fe61926-4ef4-4f0f-9b57-30592ab815d1 nodeName:}" failed. No retries permitted until 2026-07-02 17:07:52.117693516 +0000 UTC m=+622.671535921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5fe61926-4ef4-4f0f-9b57-30592ab815d1-webhook-cert") pod "maas-controller-6c4db889fc-gflnd" (UID: "5fe61926-4ef4-4f0f-9b57-30592ab815d1") : secret "maas-controller-webhook-cert" not found Jul 02 17:07:51.629228 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.629195 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx28s\" (UniqueName: \"kubernetes.io/projected/5fe61926-4ef4-4f0f-9b57-30592ab815d1-kube-api-access-xx28s\") pod \"maas-controller-6c4db889fc-gflnd\" (UID: \"5fe61926-4ef4-4f0f-9b57-30592ab815d1\") " pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:07:51.709999 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.709915 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67458d6c8d-xvsps"] Jul 02 17:07:51.713092 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.713076 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:07:51.735751 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.735726 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67458d6c8d-xvsps"] Jul 02 17:07:51.824109 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.824073 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6tdq\" (UniqueName: \"kubernetes.io/projected/c19ea66d-dea8-49f1-977e-d9a711cbebcc-kube-api-access-d6tdq\") pod \"maas-controller-67458d6c8d-xvsps\" (UID: \"c19ea66d-dea8-49f1-977e-d9a711cbebcc\") " pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:07:51.824301 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.824135 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c19ea66d-dea8-49f1-977e-d9a711cbebcc-webhook-cert\") pod \"maas-controller-67458d6c8d-xvsps\" (UID: \"c19ea66d-dea8-49f1-977e-d9a711cbebcc\") " pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:07:51.925119 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.925083 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6tdq\" (UniqueName: \"kubernetes.io/projected/c19ea66d-dea8-49f1-977e-d9a711cbebcc-kube-api-access-d6tdq\") pod \"maas-controller-67458d6c8d-xvsps\" (UID: \"c19ea66d-dea8-49f1-977e-d9a711cbebcc\") " pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:07:51.925348 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.925136 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c19ea66d-dea8-49f1-977e-d9a711cbebcc-webhook-cert\") pod \"maas-controller-67458d6c8d-xvsps\" (UID: \"c19ea66d-dea8-49f1-977e-d9a711cbebcc\") " pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:07:51.927517 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.927498 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c19ea66d-dea8-49f1-977e-d9a711cbebcc-webhook-cert\") pod \"maas-controller-67458d6c8d-xvsps\" (UID: \"c19ea66d-dea8-49f1-977e-d9a711cbebcc\") " pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:07:51.938182 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:51.938157 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6tdq\" (UniqueName: \"kubernetes.io/projected/c19ea66d-dea8-49f1-977e-d9a711cbebcc-kube-api-access-d6tdq\") pod \"maas-controller-67458d6c8d-xvsps\" (UID: \"c19ea66d-dea8-49f1-977e-d9a711cbebcc\") " pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:07:52.028980 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:52.028877 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:07:52.126613 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:52.126582 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fe61926-4ef4-4f0f-9b57-30592ab815d1-webhook-cert\") pod \"maas-controller-6c4db889fc-gflnd\" (UID: \"5fe61926-4ef4-4f0f-9b57-30592ab815d1\") " pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:07:52.129166 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:52.129142 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fe61926-4ef4-4f0f-9b57-30592ab815d1-webhook-cert\") pod \"maas-controller-6c4db889fc-gflnd\" (UID: \"5fe61926-4ef4-4f0f-9b57-30592ab815d1\") " pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:07:52.178606 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:52.178581 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67458d6c8d-xvsps"] Jul 02 17:07:52.181038 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:07:52.181012 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19ea66d_dea8_49f1_977e_d9a711cbebcc.slice/crio-89aa44b454b0787a18f85c7e9743c23db607255e5647938d94947aa165c8c6bd WatchSource:0}: Error finding container 89aa44b454b0787a18f85c7e9743c23db607255e5647938d94947aa165c8c6bd: Status 404 returned error can't find the container with id 89aa44b454b0787a18f85c7e9743c23db607255e5647938d94947aa165c8c6bd Jul 02 17:07:52.336675 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:52.336641 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:07:52.467592 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:52.467556 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67458d6c8d-xvsps" event={"ID":"c19ea66d-dea8-49f1-977e-d9a711cbebcc","Type":"ContainerStarted","Data":"89aa44b454b0787a18f85c7e9743c23db607255e5647938d94947aa165c8c6bd"} Jul 02 17:07:52.474250 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:52.474224 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4db889fc-gflnd"] Jul 02 17:07:53.475546 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:53.475508 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db889fc-gflnd" event={"ID":"5fe61926-4ef4-4f0f-9b57-30592ab815d1","Type":"ContainerStarted","Data":"f9bcad3c5a91d5a3d1d83769d8319dd22bc4f8f12a48b6d1d35fe9e648bb7ae4"} Jul 02 17:07:55.488299 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:55.488254 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67458d6c8d-xvsps" event={"ID":"c19ea66d-dea8-49f1-977e-d9a711cbebcc","Type":"ContainerStarted","Data":"598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814"} Jul 02 17:07:55.490595 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:55.488357 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:07:55.490595 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:55.489758 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db889fc-gflnd" event={"ID":"5fe61926-4ef4-4f0f-9b57-30592ab815d1","Type":"ContainerStarted","Data":"2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a"} Jul 02 17:07:55.490595 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:55.489870 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:07:55.575109 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:55.575055 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67458d6c8d-xvsps" podStartSLOduration=2.123199866 podStartE2EDuration="4.575040575s" totalImagesPullingTime="2.451840709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:07:55.573389061 +0000 UTC m=+626.127231494" watchObservedRunningTime="2026-07-02 17:07:55.575040575 +0000 UTC m=+626.128883028" Jul 02 17:07:55.657326 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:07:55.657255 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c4db889fc-gflnd" podStartSLOduration=2.512865231 podStartE2EDuration="4.657240518s" totalImagesPullingTime="2.144375287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:07:55.655658763 +0000 UTC m=+626.209501197" watchObservedRunningTime="2026-07-02 17:07:55.657240518 +0000 UTC m=+626.211082938" Jul 02 17:08:06.499842 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:06.499812 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:08:06.500241 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:06.499882 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:08:06.625584 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:06.625558 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c4db889fc-gflnd"] Jul 02 17:08:06.625768 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:06.625718 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6c4db889fc-gflnd" podUID="5fe61926-4ef4-4f0f-9b57-30592ab815d1" containerName="manager" containerID="cri-o://2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a" gracePeriod=30 Jul 02 17:08:06.871687 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:06.871661 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:08:06.964933 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:06.964905 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx28s\" (UniqueName: \"kubernetes.io/projected/5fe61926-4ef4-4f0f-9b57-30592ab815d1-kube-api-access-xx28s\") pod \"5fe61926-4ef4-4f0f-9b57-30592ab815d1\" (UID: \"5fe61926-4ef4-4f0f-9b57-30592ab815d1\") " Jul 02 17:08:06.965103 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:06.964963 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fe61926-4ef4-4f0f-9b57-30592ab815d1-webhook-cert\") pod \"5fe61926-4ef4-4f0f-9b57-30592ab815d1\" (UID: \"5fe61926-4ef4-4f0f-9b57-30592ab815d1\") " Jul 02 17:08:06.967013 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:06.966987 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fe61926-4ef4-4f0f-9b57-30592ab815d1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5fe61926-4ef4-4f0f-9b57-30592ab815d1" (UID: "5fe61926-4ef4-4f0f-9b57-30592ab815d1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:08:06.967122 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:06.967048 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe61926-4ef4-4f0f-9b57-30592ab815d1-kube-api-access-xx28s" (OuterVolumeSpecName: "kube-api-access-xx28s") pod "5fe61926-4ef4-4f0f-9b57-30592ab815d1" (UID: "5fe61926-4ef4-4f0f-9b57-30592ab815d1"). InnerVolumeSpecName "kube-api-access-xx28s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:08:07.066205 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.066134 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx28s\" (UniqueName: \"kubernetes.io/projected/5fe61926-4ef4-4f0f-9b57-30592ab815d1-kube-api-access-xx28s\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:08:07.066205 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.066159 2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5fe61926-4ef4-4f0f-9b57-30592ab815d1-webhook-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:08:07.548879 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.548848 2582 generic.go:356] "Generic (PLEG): container finished" podID="5fe61926-4ef4-4f0f-9b57-30592ab815d1" containerID="2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a" exitCode=0 Jul 02 17:08:07.549314 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.548891 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db889fc-gflnd" Jul 02 17:08:07.549314 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.548907 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db889fc-gflnd" event={"ID":"5fe61926-4ef4-4f0f-9b57-30592ab815d1","Type":"ContainerDied","Data":"2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a"} Jul 02 17:08:07.549314 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.548948 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db889fc-gflnd" event={"ID":"5fe61926-4ef4-4f0f-9b57-30592ab815d1","Type":"ContainerDied","Data":"f9bcad3c5a91d5a3d1d83769d8319dd22bc4f8f12a48b6d1d35fe9e648bb7ae4"} Jul 02 17:08:07.549314 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.548969 2582 scope.go:117] "RemoveContainer" containerID="2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a" Jul 02 17:08:07.557980 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.557964 2582 scope.go:117] "RemoveContainer" containerID="2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a" Jul 02 17:08:07.558211 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:08:07.558190 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a\": container with ID starting with 2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a not found: ID does not exist" containerID="2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a" Jul 02 17:08:07.558263 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.558219 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a"} err="failed to get container status \"2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a\": rpc error: code = NotFound desc = could not find container \"2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a\": container with ID starting with 2c83d5f82f80c4c1413fac4a6e6b37bac8429e0f182b2be3e40bfbda43331d0a not found: ID does not exist" Jul 02 17:08:07.572010 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.571988 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c4db889fc-gflnd"] Jul 02 17:08:07.575705 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.575686 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c4db889fc-gflnd"] Jul 02 17:08:07.617872 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:07.617839 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe61926-4ef4-4f0f-9b57-30592ab815d1" path="/var/lib/kubelet/pods/5fe61926-4ef4-4f0f-9b57-30592ab815d1/volumes" Jul 02 17:08:26.097952 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.097916 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-86f58868c9-86ttl"] Jul 02 17:08:26.098433 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.098326 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe61926-4ef4-4f0f-9b57-30592ab815d1" containerName="manager" Jul 02 17:08:26.098433 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.098337 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe61926-4ef4-4f0f-9b57-30592ab815d1" containerName="manager" Jul 02 17:08:26.098433 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.098414 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe61926-4ef4-4f0f-9b57-30592ab815d1" containerName="manager" Jul 02 17:08:26.100430 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.100413 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:26.104350 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.104331 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cq75x\"" Jul 02 17:08:26.105296 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.105269 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 02 17:08:26.118856 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.118830 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-86f58868c9-86ttl"] Jul 02 17:08:26.134575 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.134549 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8918fad-f322-4296-8de5-bc5711a97eb3-maas-api-tls\") pod \"maas-api-86f58868c9-86ttl\" (UID: \"c8918fad-f322-4296-8de5-bc5711a97eb3\") " pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:26.134680 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.134608 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8918fad-f322-4296-8de5-bc5711a97eb3-openshift-service-ca\") pod \"maas-api-86f58868c9-86ttl\" (UID: \"c8918fad-f322-4296-8de5-bc5711a97eb3\") " pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:26.134743 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.134681 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hl9t\" (UniqueName: \"kubernetes.io/projected/c8918fad-f322-4296-8de5-bc5711a97eb3-kube-api-access-9hl9t\") pod \"maas-api-86f58868c9-86ttl\" (UID: \"c8918fad-f322-4296-8de5-bc5711a97eb3\") " pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:26.235751 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.235717 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hl9t\" (UniqueName: \"kubernetes.io/projected/c8918fad-f322-4296-8de5-bc5711a97eb3-kube-api-access-9hl9t\") pod \"maas-api-86f58868c9-86ttl\" (UID: \"c8918fad-f322-4296-8de5-bc5711a97eb3\") " pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:26.235913 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.235795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8918fad-f322-4296-8de5-bc5711a97eb3-maas-api-tls\") pod \"maas-api-86f58868c9-86ttl\" (UID: \"c8918fad-f322-4296-8de5-bc5711a97eb3\") " pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:26.235913 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.235824 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8918fad-f322-4296-8de5-bc5711a97eb3-openshift-service-ca\") pod \"maas-api-86f58868c9-86ttl\" (UID: \"c8918fad-f322-4296-8de5-bc5711a97eb3\") " pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:26.236451 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.236433 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8918fad-f322-4296-8de5-bc5711a97eb3-openshift-service-ca\") pod \"maas-api-86f58868c9-86ttl\" (UID: \"c8918fad-f322-4296-8de5-bc5711a97eb3\") " pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:26.238180 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.238160 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8918fad-f322-4296-8de5-bc5711a97eb3-maas-api-tls\") pod \"maas-api-86f58868c9-86ttl\" (UID: \"c8918fad-f322-4296-8de5-bc5711a97eb3\") " pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:26.245779 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.245757 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hl9t\" (UniqueName: \"kubernetes.io/projected/c8918fad-f322-4296-8de5-bc5711a97eb3-kube-api-access-9hl9t\") pod \"maas-api-86f58868c9-86ttl\" (UID: \"c8918fad-f322-4296-8de5-bc5711a97eb3\") " pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:26.410406 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.410330 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:26.549478 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.549453 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-86f58868c9-86ttl"] Jul 02 17:08:26.552005 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:08:26.551971 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8918fad_f322_4296_8de5_bc5711a97eb3.slice/crio-80682da272820ace0c1555679b40b4b171dc6abf4772ec80c7973943140c1494 WatchSource:0}: Error finding container 80682da272820ace0c1555679b40b4b171dc6abf4772ec80c7973943140c1494: Status 404 returned error can't find the container with id 80682da272820ace0c1555679b40b4b171dc6abf4772ec80c7973943140c1494 Jul 02 17:08:26.553534 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.553515 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 17:08:26.637061 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.637033 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-86f58868c9-86ttl" event={"ID":"c8918fad-f322-4296-8de5-bc5711a97eb3","Type":"ContainerStarted","Data":"80682da272820ace0c1555679b40b4b171dc6abf4772ec80c7973943140c1494"} Jul 02 17:08:26.800906 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.800830 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt"] Jul 02 17:08:26.804138 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.804118 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" Jul 02 17:08:26.808161 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.808143 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7hdxp\"" Jul 02 17:08:26.808488 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.808471 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 17:08:26.817559 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.817533 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt"] Jul 02 17:08:26.841414 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.841390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rm46\" (UniqueName: \"kubernetes.io/projected/d8dd3bed-0677-47c5-a094-e5140839b9c0-kube-api-access-5rm46\") pod \"payload-pre-processing-59f49fd4f6-wtqnt\" (UID: \"d8dd3bed-0677-47c5-a094-e5140839b9c0\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" Jul 02 17:08:26.841572 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.841442 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8dd3bed-0677-47c5-a094-e5140839b9c0-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-wtqnt\" (UID: \"d8dd3bed-0677-47c5-a094-e5140839b9c0\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" Jul 02 17:08:26.942859 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.942823 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8dd3bed-0677-47c5-a094-e5140839b9c0-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-wtqnt\" (UID: \"d8dd3bed-0677-47c5-a094-e5140839b9c0\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" Jul 02 17:08:26.943028 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.942936 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rm46\" (UniqueName: \"kubernetes.io/projected/d8dd3bed-0677-47c5-a094-e5140839b9c0-kube-api-access-5rm46\") pod \"payload-pre-processing-59f49fd4f6-wtqnt\" (UID: \"d8dd3bed-0677-47c5-a094-e5140839b9c0\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" Jul 02 17:08:26.943691 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.943663 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8dd3bed-0677-47c5-a094-e5140839b9c0-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-wtqnt\" (UID: \"d8dd3bed-0677-47c5-a094-e5140839b9c0\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" Jul 02 17:08:26.951187 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.951162 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rm46\" (UniqueName: \"kubernetes.io/projected/d8dd3bed-0677-47c5-a094-e5140839b9c0-kube-api-access-5rm46\") pod \"payload-pre-processing-59f49fd4f6-wtqnt\" (UID: \"d8dd3bed-0677-47c5-a094-e5140839b9c0\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" Jul 02 17:08:26.981211 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.981181 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-8cc8t"] Jul 02 17:08:26.984254 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.984235 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" Jul 02 17:08:26.999032 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:26.999012 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-8cc8t"] Jul 02 17:08:27.044346 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.044321 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a35bee41-b388-4cda-b2bf-f1f9c8d28295-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-8cc8t\" (UID: \"a35bee41-b388-4cda-b2bf-f1f9c8d28295\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" Jul 02 17:08:27.044487 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.044401 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htd88\" (UniqueName: \"kubernetes.io/projected/a35bee41-b388-4cda-b2bf-f1f9c8d28295-kube-api-access-htd88\") pod \"payload-processing-7bbcb654f4-8cc8t\" (UID: \"a35bee41-b388-4cda-b2bf-f1f9c8d28295\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" Jul 02 17:08:27.116012 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.115981 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" Jul 02 17:08:27.144877 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.144853 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a35bee41-b388-4cda-b2bf-f1f9c8d28295-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-8cc8t\" (UID: \"a35bee41-b388-4cda-b2bf-f1f9c8d28295\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" Jul 02 17:08:27.145016 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.144910 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htd88\" (UniqueName: \"kubernetes.io/projected/a35bee41-b388-4cda-b2bf-f1f9c8d28295-kube-api-access-htd88\") pod \"payload-processing-7bbcb654f4-8cc8t\" (UID: \"a35bee41-b388-4cda-b2bf-f1f9c8d28295\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" Jul 02 17:08:27.145563 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.145540 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a35bee41-b388-4cda-b2bf-f1f9c8d28295-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-8cc8t\" (UID: \"a35bee41-b388-4cda-b2bf-f1f9c8d28295\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" Jul 02 17:08:27.155565 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.155543 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htd88\" (UniqueName: \"kubernetes.io/projected/a35bee41-b388-4cda-b2bf-f1f9c8d28295-kube-api-access-htd88\") pod \"payload-processing-7bbcb654f4-8cc8t\" (UID: \"a35bee41-b388-4cda-b2bf-f1f9c8d28295\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" Jul 02 17:08:27.249376 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.249343 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt"] Jul 02 17:08:27.252853 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:08:27.252822 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8dd3bed_0677_47c5_a094_e5140839b9c0.slice/crio-2780f0850d67f3a36c6182173ecf671f031b8468709cdfdaaafb6e065ea1ab56 WatchSource:0}: Error finding container 2780f0850d67f3a36c6182173ecf671f031b8468709cdfdaaafb6e065ea1ab56: Status 404 returned error can't find the container with id 2780f0850d67f3a36c6182173ecf671f031b8468709cdfdaaafb6e065ea1ab56 Jul 02 17:08:27.294763 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.294666 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" Jul 02 17:08:27.449377 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.449355 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-8cc8t"] Jul 02 17:08:27.450007 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:08:27.449988 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35bee41_b388_4cda_b2bf_f1f9c8d28295.slice/crio-ce661be23eed1f97c4bd6d1ff696cbec7a01869d38b3c2ebf994f879ed326fd6 WatchSource:0}: Error finding container ce661be23eed1f97c4bd6d1ff696cbec7a01869d38b3c2ebf994f879ed326fd6: Status 404 returned error can't find the container with id ce661be23eed1f97c4bd6d1ff696cbec7a01869d38b3c2ebf994f879ed326fd6 Jul 02 17:08:27.644528 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.644437 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" event={"ID":"a35bee41-b388-4cda-b2bf-f1f9c8d28295","Type":"ContainerStarted","Data":"ce661be23eed1f97c4bd6d1ff696cbec7a01869d38b3c2ebf994f879ed326fd6"} Jul 02 17:08:27.645757 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:27.645727 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" event={"ID":"d8dd3bed-0677-47c5-a094-e5140839b9c0","Type":"ContainerStarted","Data":"2780f0850d67f3a36c6182173ecf671f031b8468709cdfdaaafb6e065ea1ab56"} Jul 02 17:08:28.656848 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:28.656188 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-86f58868c9-86ttl" event={"ID":"c8918fad-f322-4296-8de5-bc5711a97eb3","Type":"ContainerStarted","Data":"a7484649751b13911925dd58deecb7e848a3afaa31491944d174d0705e49032e"} Jul 02 17:08:28.656848 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:28.656710 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:28.674343 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:28.674266 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-86f58868c9-86ttl" podStartSLOduration=1.056978594 podStartE2EDuration="2.674248478s" totalImagesPullingTime="1.617269884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:08:28.672905474 +0000 UTC m=+659.226747918" watchObservedRunningTime="2026-07-02 17:08:28.674248478 +0000 UTC m=+659.228090901" Jul 02 17:08:30.669018 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:30.668980 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" event={"ID":"a35bee41-b388-4cda-b2bf-f1f9c8d28295","Type":"ContainerStarted","Data":"365785d18f87664e8b2969124ae2e39636d44a3f129183d5e55df5ab28a97325"} Jul 02 17:08:30.669507 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:30.669083 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" Jul 02 17:08:30.670510 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:30.670476 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" event={"ID":"d8dd3bed-0677-47c5-a094-e5140839b9c0","Type":"ContainerStarted","Data":"1a9befd92b5a77abb724b2316c54b167e3de4b1831ff24bf025a0866a0eae91c"} Jul 02 17:08:30.670649 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:30.670527 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" Jul 02 17:08:30.689293 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:30.689237 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" podStartSLOduration=2.207670212 podStartE2EDuration="4.689225322s" totalImagesPullingTime="2.48155511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:08:30.687348915 +0000 UTC m=+661.241191340" watchObservedRunningTime="2026-07-02 17:08:30.689225322 +0000 UTC m=+661.243067753" Jul 02 17:08:30.705105 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:30.705065 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" podStartSLOduration=2.032086067 podStartE2EDuration="4.705053294s" totalImagesPullingTime="2.672967227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:08:30.703419284 +0000 UTC m=+661.257261705" watchObservedRunningTime="2026-07-02 17:08:30.705053294 +0000 UTC m=+661.258895714" Jul 02 17:08:34.667345 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:34.667319 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-86f58868c9-86ttl" Jul 02 17:08:41.676111 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:41.676080 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-wtqnt" Jul 02 17:08:41.676615 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:08:41.676157 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8cc8t" Jul 02 17:09:33.686759 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.686677 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg"] Jul 02 17:09:33.690382 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.690358 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.693380 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.693357 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 17:09:33.694542 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.694519 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 02 17:09:33.694542 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.694537 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5lqpq\"" Jul 02 17:09:33.694796 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.694780 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 17:09:33.702203 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.702181 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg"] Jul 02 17:09:33.861015 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.860981 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.861015 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.861018 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.861255 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.861152 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.861255 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.861246 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfx86\" (UniqueName: \"kubernetes.io/projected/a6363eeb-a79b-4508-94cd-5aa9d3206994-kube-api-access-zfx86\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.861397 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.861297 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6363eeb-a79b-4508-94cd-5aa9d3206994-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.861458 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.861439 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.962624 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.962543 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.962624 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.962589 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.962624 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.962607 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.962907 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.962651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.962907 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.962695 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfx86\" (UniqueName: \"kubernetes.io/projected/a6363eeb-a79b-4508-94cd-5aa9d3206994-kube-api-access-zfx86\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.962907 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.962716 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6363eeb-a79b-4508-94cd-5aa9d3206994-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.963072 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.963008 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.963072 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.963063 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.963171 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.963070 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.964991 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.964968 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6363eeb-a79b-4508-94cd-5aa9d3206994-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.965235 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.965216 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6363eeb-a79b-4508-94cd-5aa9d3206994-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:33.971076 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:33.971054 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfx86\" (UniqueName: \"kubernetes.io/projected/a6363eeb-a79b-4508-94cd-5aa9d3206994-kube-api-access-zfx86\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g9kkg\" (UID: \"a6363eeb-a79b-4508-94cd-5aa9d3206994\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:34.003118 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:34.003092 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:34.134664 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:34.134642 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg"] Jul 02 17:09:34.978123 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:34.978065 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" event={"ID":"a6363eeb-a79b-4508-94cd-5aa9d3206994","Type":"ContainerStarted","Data":"c10b36e7b9ff0bdcc44f54437be3ba6a0329bdfe57dd47c4c5c87115d4db4913"} Jul 02 17:09:35.984742 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:35.984704 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" event={"ID":"a6363eeb-a79b-4508-94cd-5aa9d3206994","Type":"ContainerStarted","Data":"9a25d1201b935acd158b74eea3111d824465c36a9c11b1e7558631e367068367"} Jul 02 17:09:36.004139 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:36.004091 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" podStartSLOduration=1.973715677 podStartE2EDuration="3.004077553s" totalImagesPullingTime="1.030361876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:09:36.00246368 +0000 UTC m=+726.556306102" watchObservedRunningTime="2026-07-02 17:09:36.004077553 +0000 UTC m=+726.557919973" Jul 02 17:09:44.004162 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:44.004129 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:44.004601 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:44.004182 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:44.016491 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:44.016468 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:09:44.032206 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:09:44.032183 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g9kkg" Jul 02 17:10:14.695695 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.695641 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz"] Jul 02 17:10:14.699271 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.699246 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.701906 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.701886 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 02 17:10:14.709829 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.709807 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz"] Jul 02 17:10:14.856615 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.856582 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.856615 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.856627 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.856861 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.856654 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvxql\" (UniqueName: \"kubernetes.io/projected/13a53eb3-0d2f-4490-9571-633832c19d3f-kube-api-access-wvxql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.856861 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.856703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.856861 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.856797 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13a53eb3-0d2f-4490-9571-633832c19d3f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.857011 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.856911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.957687 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.957612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.957687 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.957663 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvxql\" (UniqueName: \"kubernetes.io/projected/13a53eb3-0d2f-4490-9571-633832c19d3f-kube-api-access-wvxql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.957870 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.957697 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.957870 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.957750 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13a53eb3-0d2f-4490-9571-633832c19d3f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.957870 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.957843 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.958028 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.957891 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.958028 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.958013 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.958154 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.958094 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.958250 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.958225 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.960421 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.960376 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13a53eb3-0d2f-4490-9571-633832c19d3f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.960669 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.960647 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13a53eb3-0d2f-4490-9571-633832c19d3f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:14.965742 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:14.965716 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvxql\" (UniqueName: \"kubernetes.io/projected/13a53eb3-0d2f-4490-9571-633832c19d3f-kube-api-access-wvxql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-25zmz\" (UID: \"13a53eb3-0d2f-4490-9571-633832c19d3f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:15.011794 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:15.011765 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:15.141770 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:15.141734 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz"] Jul 02 17:10:15.145321 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:10:15.145296 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a53eb3_0d2f_4490_9571_633832c19d3f.slice/crio-6f8528361a644f0e912ab02d509a2be7354e9400852fefaa05073f74ce6a4d58 WatchSource:0}: Error finding container 6f8528361a644f0e912ab02d509a2be7354e9400852fefaa05073f74ce6a4d58: Status 404 returned error can't find the container with id 6f8528361a644f0e912ab02d509a2be7354e9400852fefaa05073f74ce6a4d58 Jul 02 17:10:15.172687 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:15.172643 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" event={"ID":"13a53eb3-0d2f-4490-9571-633832c19d3f","Type":"ContainerStarted","Data":"6f8528361a644f0e912ab02d509a2be7354e9400852fefaa05073f74ce6a4d58"} Jul 02 17:10:16.179013 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:16.178975 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" event={"ID":"13a53eb3-0d2f-4490-9571-633832c19d3f","Type":"ContainerStarted","Data":"108292bc330420c7de3476291e66ecf6a7ad577ea3bafbc405845db34faa4776"} Jul 02 17:10:16.198229 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:16.198181 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" podStartSLOduration=1.979917489 podStartE2EDuration="2.198166093s" totalImagesPullingTime="218.248604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:10:16.196096993 +0000 UTC m=+766.749939415" watchObservedRunningTime="2026-07-02 17:10:16.198166093 +0000 UTC m=+766.752008515" Jul 02 17:10:25.012789 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:25.012756 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:25.013173 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:25.012886 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:25.025413 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:25.025391 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:10:25.233516 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:10:25.233487 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-25zmz" Jul 02 17:12:30.948554 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:30.948472 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:12:30.949340 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:30.949269 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:12:50.607600 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.607554 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67458d6c8d-xvsps"] Jul 02 17:12:50.608181 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.607823 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-67458d6c8d-xvsps" podUID="c19ea66d-dea8-49f1-977e-d9a711cbebcc" containerName="manager" containerID="cri-o://598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814" gracePeriod=30 Jul 02 17:12:50.863556 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.863485 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:12:50.952946 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.952907 2582 generic.go:356] "Generic (PLEG): container finished" podID="c19ea66d-dea8-49f1-977e-d9a711cbebcc" containerID="598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814" exitCode=0 Jul 02 17:12:50.953125 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.952943 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67458d6c8d-xvsps" event={"ID":"c19ea66d-dea8-49f1-977e-d9a711cbebcc","Type":"ContainerDied","Data":"598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814"} Jul 02 17:12:50.953125 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.953001 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67458d6c8d-xvsps" event={"ID":"c19ea66d-dea8-49f1-977e-d9a711cbebcc","Type":"ContainerDied","Data":"89aa44b454b0787a18f85c7e9743c23db607255e5647938d94947aa165c8c6bd"} Jul 02 17:12:50.953125 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.952954 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67458d6c8d-xvsps" Jul 02 17:12:50.953125 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.953035 2582 scope.go:117] "RemoveContainer" containerID="598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814" Jul 02 17:12:50.958608 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.958573 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c19ea66d-dea8-49f1-977e-d9a711cbebcc-webhook-cert\") pod \"c19ea66d-dea8-49f1-977e-d9a711cbebcc\" (UID: \"c19ea66d-dea8-49f1-977e-d9a711cbebcc\") " Jul 02 17:12:50.958740 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.958640 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6tdq\" (UniqueName: \"kubernetes.io/projected/c19ea66d-dea8-49f1-977e-d9a711cbebcc-kube-api-access-d6tdq\") pod \"c19ea66d-dea8-49f1-977e-d9a711cbebcc\" (UID: \"c19ea66d-dea8-49f1-977e-d9a711cbebcc\") " Jul 02 17:12:50.960778 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.960746 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c19ea66d-dea8-49f1-977e-d9a711cbebcc-kube-api-access-d6tdq" (OuterVolumeSpecName: "kube-api-access-d6tdq") pod "c19ea66d-dea8-49f1-977e-d9a711cbebcc" (UID: "c19ea66d-dea8-49f1-977e-d9a711cbebcc"). InnerVolumeSpecName "kube-api-access-d6tdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:12:50.960778 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.960768 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c19ea66d-dea8-49f1-977e-d9a711cbebcc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c19ea66d-dea8-49f1-977e-d9a711cbebcc" (UID: "c19ea66d-dea8-49f1-977e-d9a711cbebcc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:12:50.962052 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.962032 2582 scope.go:117] "RemoveContainer" containerID="598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814" Jul 02 17:12:50.962380 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:12:50.962356 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814\": container with ID starting with 598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814 not found: ID does not exist" containerID="598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814" Jul 02 17:12:50.962474 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:50.962387 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814"} err="failed to get container status \"598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814\": rpc error: code = NotFound desc = could not find container \"598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814\": container with ID starting with 598e7b4ac63530f629c487d3779cc47f281a297b8f7e822d3988655720905814 not found: ID does not exist" Jul 02 17:12:51.059853 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:51.059811 2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c19ea66d-dea8-49f1-977e-d9a711cbebcc-webhook-cert\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:12:51.059853 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:51.059852 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6tdq\" (UniqueName: \"kubernetes.io/projected/c19ea66d-dea8-49f1-977e-d9a711cbebcc-kube-api-access-d6tdq\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:12:51.274401 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:51.274369 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67458d6c8d-xvsps"] Jul 02 17:12:51.280048 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:51.280020 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67458d6c8d-xvsps"] Jul 02 17:12:51.625700 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:51.625666 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c19ea66d-dea8-49f1-977e-d9a711cbebcc" path="/var/lib/kubelet/pods/c19ea66d-dea8-49f1-977e-d9a711cbebcc/volumes" Jul 02 17:12:52.058646 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.058565 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67458d6c8d-gcwcs"] Jul 02 17:12:52.059098 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.059075 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19ea66d-dea8-49f1-977e-d9a711cbebcc" containerName="manager" Jul 02 17:12:52.059098 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.059097 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19ea66d-dea8-49f1-977e-d9a711cbebcc" containerName="manager" Jul 02 17:12:52.059334 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.059212 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c19ea66d-dea8-49f1-977e-d9a711cbebcc" containerName="manager" Jul 02 17:12:52.063948 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.063928 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67458d6c8d-gcwcs" Jul 02 17:12:52.067932 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.067905 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p5ttx\"" Jul 02 17:12:52.068054 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.067962 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 17:12:52.068054 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.067908 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 17:12:52.071318 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.071290 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67458d6c8d-gcwcs"] Jul 02 17:12:52.170571 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.170527 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c191ec2e-5a7a-449c-b2c0-cf5d832a020d-webhook-cert\") pod \"maas-controller-67458d6c8d-gcwcs\" (UID: \"c191ec2e-5a7a-449c-b2c0-cf5d832a020d\") " pod="opendatahub/maas-controller-67458d6c8d-gcwcs" Jul 02 17:12:52.170786 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.170752 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crk9d\" (UniqueName: \"kubernetes.io/projected/c191ec2e-5a7a-449c-b2c0-cf5d832a020d-kube-api-access-crk9d\") pod \"maas-controller-67458d6c8d-gcwcs\" (UID: \"c191ec2e-5a7a-449c-b2c0-cf5d832a020d\") " pod="opendatahub/maas-controller-67458d6c8d-gcwcs" Jul 02 17:12:52.271715 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.271682 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crk9d\" (UniqueName: \"kubernetes.io/projected/c191ec2e-5a7a-449c-b2c0-cf5d832a020d-kube-api-access-crk9d\") pod \"maas-controller-67458d6c8d-gcwcs\" (UID: \"c191ec2e-5a7a-449c-b2c0-cf5d832a020d\") " pod="opendatahub/maas-controller-67458d6c8d-gcwcs" Jul 02 17:12:52.271902 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.271728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c191ec2e-5a7a-449c-b2c0-cf5d832a020d-webhook-cert\") pod \"maas-controller-67458d6c8d-gcwcs\" (UID: \"c191ec2e-5a7a-449c-b2c0-cf5d832a020d\") " pod="opendatahub/maas-controller-67458d6c8d-gcwcs" Jul 02 17:12:52.274236 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.274206 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c191ec2e-5a7a-449c-b2c0-cf5d832a020d-webhook-cert\") pod \"maas-controller-67458d6c8d-gcwcs\" (UID: \"c191ec2e-5a7a-449c-b2c0-cf5d832a020d\") " pod="opendatahub/maas-controller-67458d6c8d-gcwcs" Jul 02 17:12:52.279608 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.279568 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crk9d\" (UniqueName: \"kubernetes.io/projected/c191ec2e-5a7a-449c-b2c0-cf5d832a020d-kube-api-access-crk9d\") pod \"maas-controller-67458d6c8d-gcwcs\" (UID: \"c191ec2e-5a7a-449c-b2c0-cf5d832a020d\") " pod="opendatahub/maas-controller-67458d6c8d-gcwcs" Jul 02 17:12:52.377432 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.377388 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67458d6c8d-gcwcs" Jul 02 17:12:52.515679 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.515650 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67458d6c8d-gcwcs"] Jul 02 17:12:52.517825 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:12:52.517798 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc191ec2e_5a7a_449c_b2c0_cf5d832a020d.slice/crio-13e4af567aa9d58fd708a2c0c9e7ea6d41e50730df13a479254cb0041f470a75 WatchSource:0}: Error finding container 13e4af567aa9d58fd708a2c0c9e7ea6d41e50730df13a479254cb0041f470a75: Status 404 returned error can't find the container with id 13e4af567aa9d58fd708a2c0c9e7ea6d41e50730df13a479254cb0041f470a75 Jul 02 17:12:52.966607 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.966566 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67458d6c8d-gcwcs" event={"ID":"c191ec2e-5a7a-449c-b2c0-cf5d832a020d","Type":"ContainerStarted","Data":"f38141743d192a2c6f0fbddbed57987018276784d5bafdf977e4fc51eac49ea9"} Jul 02 17:12:52.967087 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.966634 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67458d6c8d-gcwcs" event={"ID":"c191ec2e-5a7a-449c-b2c0-cf5d832a020d","Type":"ContainerStarted","Data":"13e4af567aa9d58fd708a2c0c9e7ea6d41e50730df13a479254cb0041f470a75"} Jul 02 17:12:52.967087 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.966664 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67458d6c8d-gcwcs" Jul 02 17:12:52.985498 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:12:52.985446 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67458d6c8d-gcwcs" podStartSLOduration=0.62697779 podStartE2EDuration="985.42938ms" totalImagesPullingTime="358.45159ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:12:52.984327461 +0000 UTC m=+923.538169883" watchObservedRunningTime="2026-07-02 17:12:52.98542938 +0000 UTC m=+923.539271820" Jul 02 17:13:03.977080 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:13:03.977043 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67458d6c8d-gcwcs" Jul 02 17:17:30.983054 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:30.982968 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:17:30.984975 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:30.984953 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:17:36.237045 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:36.237008 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf"] Jul 02 17:17:36.237587 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:36.237205 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" podUID="5ff2bf84-4811-483a-b647-42b2b06805b2" containerName="manager" containerID="cri-o://4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9" gracePeriod=10 Jul 02 17:17:39.894269 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:39.894244 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:17:40.061941 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.061839 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ff2bf84-4811-483a-b647-42b2b06805b2-extensions-socket-volume\") pod \"5ff2bf84-4811-483a-b647-42b2b06805b2\" (UID: \"5ff2bf84-4811-483a-b647-42b2b06805b2\") " Jul 02 17:17:40.061941 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.061922 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qjnx\" (UniqueName: \"kubernetes.io/projected/5ff2bf84-4811-483a-b647-42b2b06805b2-kube-api-access-6qjnx\") pod \"5ff2bf84-4811-483a-b647-42b2b06805b2\" (UID: \"5ff2bf84-4811-483a-b647-42b2b06805b2\") " Jul 02 17:17:40.062328 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.062275 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ff2bf84-4811-483a-b647-42b2b06805b2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5ff2bf84-4811-483a-b647-42b2b06805b2" (UID: "5ff2bf84-4811-483a-b647-42b2b06805b2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:17:40.064118 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.064097 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ff2bf84-4811-483a-b647-42b2b06805b2-kube-api-access-6qjnx" (OuterVolumeSpecName: "kube-api-access-6qjnx") pod "5ff2bf84-4811-483a-b647-42b2b06805b2" (UID: "5ff2bf84-4811-483a-b647-42b2b06805b2"). InnerVolumeSpecName "kube-api-access-6qjnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:17:40.163352 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.163321 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ff2bf84-4811-483a-b647-42b2b06805b2-extensions-socket-volume\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:17:40.163352 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.163348 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qjnx\" (UniqueName: \"kubernetes.io/projected/5ff2bf84-4811-483a-b647-42b2b06805b2-kube-api-access-6qjnx\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:17:40.428237 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.428199 2582 generic.go:356] "Generic (PLEG): container finished" podID="5ff2bf84-4811-483a-b647-42b2b06805b2" containerID="4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9" exitCode=0 Jul 02 17:17:40.428433 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.428248 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" Jul 02 17:17:40.428433 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.428310 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" event={"ID":"5ff2bf84-4811-483a-b647-42b2b06805b2","Type":"ContainerDied","Data":"4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9"} Jul 02 17:17:40.428433 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.428368 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf" event={"ID":"5ff2bf84-4811-483a-b647-42b2b06805b2","Type":"ContainerDied","Data":"7b16c3cf367705a6d321ba9f5353fce4d5f66db726319e30ff19ed6cc5ddaf3c"} Jul 02 17:17:40.428433 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.428393 2582 scope.go:117] "RemoveContainer" containerID="4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9" Jul 02 17:17:40.438042 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.438025 2582 scope.go:117] "RemoveContainer" containerID="4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9" Jul 02 17:17:40.438317 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:17:40.438294 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9\": container with ID starting with 4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9 not found: ID does not exist" containerID="4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9" Jul 02 17:17:40.438404 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.438330 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9"} err="failed to get container status \"4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9\": rpc error: code = NotFound desc = could not find container \"4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9\": container with ID starting with 4c6b7e5d92d18cb4f1ff82f9aa4c2bb153d6621272ae419f0b357f918851d7e9 not found: ID does not exist" Jul 02 17:17:40.449936 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.449914 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf"] Jul 02 17:17:40.455632 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:40.455611 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cb5gf"] Jul 02 17:17:41.618179 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:17:41.618145 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ff2bf84-4811-483a-b647-42b2b06805b2" path="/var/lib/kubelet/pods/5ff2bf84-4811-483a-b647-42b2b06805b2/volumes" Jul 02 17:18:37.448455 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.448421 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf"] Jul 02 17:18:37.448860 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.448822 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff2bf84-4811-483a-b647-42b2b06805b2" containerName="manager" Jul 02 17:18:37.448860 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.448833 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff2bf84-4811-483a-b647-42b2b06805b2" containerName="manager" Jul 02 17:18:37.448935 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.448897 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ff2bf84-4811-483a-b647-42b2b06805b2" containerName="manager" Jul 02 17:18:37.452940 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.452923 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" Jul 02 17:18:37.455844 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.455820 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p8crq\"" Jul 02 17:18:37.456081 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.456067 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 17:18:37.456289 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.456253 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 17:18:37.464899 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.464875 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf"] Jul 02 17:18:37.526271 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.526238 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg9mr\" (UniqueName: \"kubernetes.io/projected/4b6e6e58-7605-4781-a34e-106adeb1b933-kube-api-access-fg9mr\") pod \"kuadrant-operator-controller-manager-86878c769f-kkctf\" (UID: \"4b6e6e58-7605-4781-a34e-106adeb1b933\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" Jul 02 17:18:37.526271 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.526274 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b6e6e58-7605-4781-a34e-106adeb1b933-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kkctf\" (UID: \"4b6e6e58-7605-4781-a34e-106adeb1b933\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" Jul 02 17:18:37.627066 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.627035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg9mr\" (UniqueName: \"kubernetes.io/projected/4b6e6e58-7605-4781-a34e-106adeb1b933-kube-api-access-fg9mr\") pod \"kuadrant-operator-controller-manager-86878c769f-kkctf\" (UID: \"4b6e6e58-7605-4781-a34e-106adeb1b933\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" Jul 02 17:18:37.627066 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.627069 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b6e6e58-7605-4781-a34e-106adeb1b933-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kkctf\" (UID: \"4b6e6e58-7605-4781-a34e-106adeb1b933\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" Jul 02 17:18:37.627445 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.627423 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b6e6e58-7605-4781-a34e-106adeb1b933-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kkctf\" (UID: \"4b6e6e58-7605-4781-a34e-106adeb1b933\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" Jul 02 17:18:37.636514 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.636491 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg9mr\" (UniqueName: \"kubernetes.io/projected/4b6e6e58-7605-4781-a34e-106adeb1b933-kube-api-access-fg9mr\") pod \"kuadrant-operator-controller-manager-86878c769f-kkctf\" (UID: \"4b6e6e58-7605-4781-a34e-106adeb1b933\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" Jul 02 17:18:37.763067 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.762984 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" Jul 02 17:18:37.907166 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:37.907117 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf"] Jul 02 17:18:37.909704 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:18:37.909676 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6e6e58_7605_4781_a34e_106adeb1b933.slice/crio-8df3c087b103a90131d5e19db0b31fcc50a5d840cb11e511a5d08daea1379db5 WatchSource:0}: Error finding container 8df3c087b103a90131d5e19db0b31fcc50a5d840cb11e511a5d08daea1379db5: Status 404 returned error can't find the container with id 8df3c087b103a90131d5e19db0b31fcc50a5d840cb11e511a5d08daea1379db5 Jul 02 17:18:38.711937 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:38.711906 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" event={"ID":"4b6e6e58-7605-4781-a34e-106adeb1b933","Type":"ContainerStarted","Data":"586df16c76ef5af6df30eea4b0a4680b3ccb4129b7a84053bca086e70532d267"} Jul 02 17:18:38.712353 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:38.711964 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" event={"ID":"4b6e6e58-7605-4781-a34e-106adeb1b933","Type":"ContainerStarted","Data":"8df3c087b103a90131d5e19db0b31fcc50a5d840cb11e511a5d08daea1379db5"} Jul 02 17:18:38.712353 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:38.711993 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" Jul 02 17:18:38.747784 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:38.747738 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" podStartSLOduration=1.747723929 podStartE2EDuration="1.747723929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:18:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:18:38.746036815 +0000 UTC m=+1269.299879253" watchObservedRunningTime="2026-07-02 17:18:38.747723929 +0000 UTC m=+1269.301566351" Jul 02 17:18:49.718894 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:18:49.718864 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkctf" Jul 02 17:22:31.014951 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:22:31.014917 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:22:31.017927 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:22:31.017908 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:24:57.194072 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.194031 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4"] Jul 02 17:24:57.198290 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.198260 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:57.201431 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.201412 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-9fa643a0-serving-cert\"" Jul 02 17:24:57.209860 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.209837 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4"] Jul 02 17:24:57.312553 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.312526 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-maas-api-tls\") pod \"maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:57.312743 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.312570 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m9d5\" (UniqueName: \"kubernetes.io/projected/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-kube-api-access-4m9d5\") pod \"maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:57.312743 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.312592 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-openshift-service-ca\") pod \"maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:57.413827 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.413787 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-maas-api-tls\") pod \"maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:57.413987 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.413842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m9d5\" (UniqueName: \"kubernetes.io/projected/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-kube-api-access-4m9d5\") pod \"maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:57.413987 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.413869 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-openshift-service-ca\") pod \"maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:57.413987 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:24:57.413937 2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-9fa643a0-serving-cert: secret "maas-api-e2e-ait-9fa643a0-serving-cert" not found Jul 02 17:24:57.414128 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:24:57.414001 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-maas-api-tls podName:4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89 nodeName:}" failed. No retries permitted until 2026-07-02 17:24:57.913985235 +0000 UTC m=+1648.467827638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-maas-api-tls") pod "maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" (UID: "4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89") : secret "maas-api-e2e-ait-9fa643a0-serving-cert" not found Jul 02 17:24:57.414634 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.414617 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-openshift-service-ca\") pod \"maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:57.422534 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.422512 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m9d5\" (UniqueName: \"kubernetes.io/projected/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-kube-api-access-4m9d5\") pod \"maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:57.919950 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.919915 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-maas-api-tls\") pod \"maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:57.922393 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:57.922370 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-maas-api-tls\") pod \"maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:58.108963 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:58.108927 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:58.248039 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:58.248012 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4"] Jul 02 17:24:58.250770 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:24:58.250739 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4912c296_3dc9_4d7a_ac1d_3f85c6f6eb89.slice/crio-31cca7ea6dc104fe940a4a5ff4542a7da850e30b83ff66853af9ed200fe02454 WatchSource:0}: Error finding container 31cca7ea6dc104fe940a4a5ff4542a7da850e30b83ff66853af9ed200fe02454: Status 404 returned error can't find the container with id 31cca7ea6dc104fe940a4a5ff4542a7da850e30b83ff66853af9ed200fe02454 Jul 02 17:24:58.252103 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:58.252081 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 17:24:58.622971 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:58.622939 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" event={"ID":"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89","Type":"ContainerStarted","Data":"31cca7ea6dc104fe940a4a5ff4542a7da850e30b83ff66853af9ed200fe02454"} Jul 02 17:24:59.630686 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:59.630647 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" event={"ID":"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89","Type":"ContainerStarted","Data":"cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231"} Jul 02 17:24:59.631122 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:59.630705 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:24:59.649426 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:24:59.649382 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" podStartSLOduration=2.109091961 podStartE2EDuration="2.649364494s" totalImagesPullingTime="540.272533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:24:59.647883779 +0000 UTC m=+1650.201726201" watchObservedRunningTime="2026-07-02 17:24:59.649364494 +0000 UTC m=+1650.203206914" Jul 02 17:25:02.595789 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:02.595759 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4"] Jul 02 17:25:02.596222 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:02.595946 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" podUID="4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89" containerName="maas-api" containerID="cri-o://cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231" gracePeriod=30 Jul 02 17:25:02.839865 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:02.839836 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:25:02.970586 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:02.970499 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m9d5\" (UniqueName: \"kubernetes.io/projected/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-kube-api-access-4m9d5\") pod \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " Jul 02 17:25:02.970741 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:02.970622 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-maas-api-tls\") pod \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " Jul 02 17:25:02.970741 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:02.970655 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-openshift-service-ca\") pod \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\" (UID: \"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89\") " Jul 02 17:25:02.971090 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:02.971062 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89" (UID: "4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:25:02.972654 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:02.972624 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-kube-api-access-4m9d5" (OuterVolumeSpecName: "kube-api-access-4m9d5") pod "4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89" (UID: "4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89"). InnerVolumeSpecName "kube-api-access-4m9d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:02.972743 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:02.972672 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89" (UID: "4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:25:03.072249 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.072213 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-maas-api-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:25:03.072249 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.072249 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-openshift-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:25:03.072249 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.072258 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m9d5\" (UniqueName: \"kubernetes.io/projected/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89-kube-api-access-4m9d5\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:25:03.649905 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.649870 2582 generic.go:356] "Generic (PLEG): container finished" podID="4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89" containerID="cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231" exitCode=0 Jul 02 17:25:03.650236 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.649925 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" Jul 02 17:25:03.650236 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.649956 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" event={"ID":"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89","Type":"ContainerDied","Data":"cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231"} Jul 02 17:25:03.650236 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.650010 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4" event={"ID":"4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89","Type":"ContainerDied","Data":"31cca7ea6dc104fe940a4a5ff4542a7da850e30b83ff66853af9ed200fe02454"} Jul 02 17:25:03.650236 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.650041 2582 scope.go:117] "RemoveContainer" containerID="cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231" Jul 02 17:25:03.659752 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.659734 2582 scope.go:117] "RemoveContainer" containerID="cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231" Jul 02 17:25:03.659970 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:25:03.659954 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231\": container with ID starting with cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231 not found: ID does not exist" containerID="cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231" Jul 02 17:25:03.660023 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.659977 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231"} err="failed to get container status \"cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231\": rpc error: code = NotFound desc = could not find container \"cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231\": container with ID starting with cdd540201554ab2fe69f57c6121f3aac9bc18b54d444b89e85b7cd1d6d839231 not found: ID does not exist" Jul 02 17:25:03.666770 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.666747 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4"] Jul 02 17:25:03.675363 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:03.675340 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-9fa643a0-7b4466588b-d8hn4"] Jul 02 17:25:05.618052 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:05.618021 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89" path="/var/lib/kubelet/pods/4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89/volumes" Jul 02 17:25:10.305593 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.305562 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd"] Jul 02 17:25:10.306068 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.305972 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89" containerName="maas-api" Jul 02 17:25:10.306068 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.305983 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89" containerName="maas-api" Jul 02 17:25:10.306068 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.306068 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4912c296-3dc9-4d7a-ac1d-3f85c6f6eb89" containerName="maas-api" Jul 02 17:25:10.310407 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.310388 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:10.313428 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.313396 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-cdcb9ecf-serving-cert\"" Jul 02 17:25:10.322078 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.322056 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd"] Jul 02 17:25:10.450213 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.450170 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1f48199-9ccc-466d-b643-0241c3c37d4a-maas-api-tls\") pod \"maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:10.450441 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.450235 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f48199-9ccc-466d-b643-0241c3c37d4a-openshift-service-ca\") pod \"maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:10.450441 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.450312 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84hxx\" (UniqueName: \"kubernetes.io/projected/e1f48199-9ccc-466d-b643-0241c3c37d4a-kube-api-access-84hxx\") pod \"maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:10.551383 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.551349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1f48199-9ccc-466d-b643-0241c3c37d4a-maas-api-tls\") pod \"maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:10.551554 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.551399 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f48199-9ccc-466d-b643-0241c3c37d4a-openshift-service-ca\") pod \"maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:10.551554 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.551437 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84hxx\" (UniqueName: \"kubernetes.io/projected/e1f48199-9ccc-466d-b643-0241c3c37d4a-kube-api-access-84hxx\") pod \"maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:10.552117 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.552097 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f48199-9ccc-466d-b643-0241c3c37d4a-openshift-service-ca\") pod \"maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:10.553830 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.553807 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1f48199-9ccc-466d-b643-0241c3c37d4a-maas-api-tls\") pod \"maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:10.561103 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.561026 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84hxx\" (UniqueName: \"kubernetes.io/projected/e1f48199-9ccc-466d-b643-0241c3c37d4a-kube-api-access-84hxx\") pod \"maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:10.622928 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.622896 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:10.769359 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:10.769333 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd"] Jul 02 17:25:10.771874 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:25:10.771847 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f48199_9ccc_466d_b643_0241c3c37d4a.slice/crio-643f236be27ba2f66f45d278fe5166a62efbc907344d9729ec93e17300c4b156 WatchSource:0}: Error finding container 643f236be27ba2f66f45d278fe5166a62efbc907344d9729ec93e17300c4b156: Status 404 returned error can't find the container with id 643f236be27ba2f66f45d278fe5166a62efbc907344d9729ec93e17300c4b156 Jul 02 17:25:11.703374 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:11.703329 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" event={"ID":"e1f48199-9ccc-466d-b643-0241c3c37d4a","Type":"ContainerStarted","Data":"d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72"} Jul 02 17:25:11.703782 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:11.703393 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" event={"ID":"e1f48199-9ccc-466d-b643-0241c3c37d4a","Type":"ContainerStarted","Data":"643f236be27ba2f66f45d278fe5166a62efbc907344d9729ec93e17300c4b156"} Jul 02 17:25:11.703782 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:11.703434 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:11.727758 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:11.727706 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" podStartSLOduration=1.331143188 podStartE2EDuration="1.72769113s" totalImagesPullingTime="396.547942ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:25:11.725954647 +0000 UTC m=+1662.279797109" watchObservedRunningTime="2026-07-02 17:25:11.72769113 +0000 UTC m=+1662.281533550" Jul 02 17:25:15.821681 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:15.821642 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd"] Jul 02 17:25:15.822080 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:15.821910 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" podUID="e1f48199-9ccc-466d-b643-0241c3c37d4a" containerName="maas-api" containerID="cri-o://d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72" gracePeriod=30 Jul 02 17:25:16.078612 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.078552 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:16.208032 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.207997 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f48199-9ccc-466d-b643-0241c3c37d4a-openshift-service-ca\") pod \"e1f48199-9ccc-466d-b643-0241c3c37d4a\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " Jul 02 17:25:16.208200 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.208051 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84hxx\" (UniqueName: \"kubernetes.io/projected/e1f48199-9ccc-466d-b643-0241c3c37d4a-kube-api-access-84hxx\") pod \"e1f48199-9ccc-466d-b643-0241c3c37d4a\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " Jul 02 17:25:16.208200 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.208079 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1f48199-9ccc-466d-b643-0241c3c37d4a-maas-api-tls\") pod \"e1f48199-9ccc-466d-b643-0241c3c37d4a\" (UID: \"e1f48199-9ccc-466d-b643-0241c3c37d4a\") " Jul 02 17:25:16.208442 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.208421 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1f48199-9ccc-466d-b643-0241c3c37d4a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e1f48199-9ccc-466d-b643-0241c3c37d4a" (UID: "e1f48199-9ccc-466d-b643-0241c3c37d4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:25:16.210159 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.210129 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1f48199-9ccc-466d-b643-0241c3c37d4a-kube-api-access-84hxx" (OuterVolumeSpecName: "kube-api-access-84hxx") pod "e1f48199-9ccc-466d-b643-0241c3c37d4a" (UID: "e1f48199-9ccc-466d-b643-0241c3c37d4a"). InnerVolumeSpecName "kube-api-access-84hxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:16.210159 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.210152 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1f48199-9ccc-466d-b643-0241c3c37d4a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e1f48199-9ccc-466d-b643-0241c3c37d4a" (UID: "e1f48199-9ccc-466d-b643-0241c3c37d4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:25:16.309607 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.309553 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f48199-9ccc-466d-b643-0241c3c37d4a-openshift-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:25:16.309607 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.309599 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84hxx\" (UniqueName: \"kubernetes.io/projected/e1f48199-9ccc-466d-b643-0241c3c37d4a-kube-api-access-84hxx\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:25:16.309607 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.309610 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1f48199-9ccc-466d-b643-0241c3c37d4a-maas-api-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:25:16.731055 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.731024 2582 generic.go:356] "Generic (PLEG): container finished" podID="e1f48199-9ccc-466d-b643-0241c3c37d4a" containerID="d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72" exitCode=0 Jul 02 17:25:16.731227 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.731069 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" Jul 02 17:25:16.731227 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.731112 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" event={"ID":"e1f48199-9ccc-466d-b643-0241c3c37d4a","Type":"ContainerDied","Data":"d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72"} Jul 02 17:25:16.731227 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.731163 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd" event={"ID":"e1f48199-9ccc-466d-b643-0241c3c37d4a","Type":"ContainerDied","Data":"643f236be27ba2f66f45d278fe5166a62efbc907344d9729ec93e17300c4b156"} Jul 02 17:25:16.731227 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.731186 2582 scope.go:117] "RemoveContainer" containerID="d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72" Jul 02 17:25:16.740758 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.740743 2582 scope.go:117] "RemoveContainer" containerID="d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72" Jul 02 17:25:16.741003 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:25:16.740986 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72\": container with ID starting with d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72 not found: ID does not exist" containerID="d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72" Jul 02 17:25:16.741061 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.741010 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72"} err="failed to get container status \"d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72\": rpc error: code = NotFound desc = could not find container \"d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72\": container with ID starting with d77027be070224f17316d3d311ca3306ffaf69c238b569c64dbb9ea35d7d3b72 not found: ID does not exist" Jul 02 17:25:16.754070 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.754050 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd"] Jul 02 17:25:16.759582 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:16.759562 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-cdcb9ecf-7c6877b4df-9cdcd"] Jul 02 17:25:17.619911 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:17.619877 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1f48199-9ccc-466d-b643-0241c3c37d4a" path="/var/lib/kubelet/pods/e1f48199-9ccc-466d-b643-0241c3c37d4a/volumes" Jul 02 17:25:29.192126 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.192029 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl"] Jul 02 17:25:29.192657 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.192619 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1f48199-9ccc-466d-b643-0241c3c37d4a" containerName="maas-api" Jul 02 17:25:29.192657 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.192639 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1f48199-9ccc-466d-b643-0241c3c37d4a" containerName="maas-api" Jul 02 17:25:29.192779 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.192759 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1f48199-9ccc-466d-b643-0241c3c37d4a" containerName="maas-api" Jul 02 17:25:29.197895 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.197874 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:29.200464 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.200442 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-2dda51e2-serving-cert\"" Jul 02 17:25:29.208674 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.208652 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl"] Jul 02 17:25:29.221088 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.221055 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/457d380e-4575-44c6-a562-62a6725bccce-openshift-service-ca\") pod \"maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:29.221230 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.221209 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksjdm\" (UniqueName: \"kubernetes.io/projected/457d380e-4575-44c6-a562-62a6725bccce-kube-api-access-ksjdm\") pod \"maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:29.221302 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.221271 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457d380e-4575-44c6-a562-62a6725bccce-maas-api-tls\") pod \"maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:29.322571 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.322535 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksjdm\" (UniqueName: \"kubernetes.io/projected/457d380e-4575-44c6-a562-62a6725bccce-kube-api-access-ksjdm\") pod \"maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:29.322731 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.322603 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457d380e-4575-44c6-a562-62a6725bccce-maas-api-tls\") pod \"maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:29.322731 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:25:29.322690 2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-2dda51e2-serving-cert: secret "maas-api-e2e-derive-2dda51e2-serving-cert" not found Jul 02 17:25:29.322805 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.322756 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/457d380e-4575-44c6-a562-62a6725bccce-openshift-service-ca\") pod \"maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:29.322879 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:25:29.322865 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457d380e-4575-44c6-a562-62a6725bccce-maas-api-tls podName:457d380e-4575-44c6-a562-62a6725bccce nodeName:}" failed. No retries permitted until 2026-07-02 17:25:29.822847081 +0000 UTC m=+1680.376689484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/457d380e-4575-44c6-a562-62a6725bccce-maas-api-tls") pod "maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" (UID: "457d380e-4575-44c6-a562-62a6725bccce") : secret "maas-api-e2e-derive-2dda51e2-serving-cert" not found Jul 02 17:25:29.323406 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.323388 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/457d380e-4575-44c6-a562-62a6725bccce-openshift-service-ca\") pod \"maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:29.331512 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.331484 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksjdm\" (UniqueName: \"kubernetes.io/projected/457d380e-4575-44c6-a562-62a6725bccce-kube-api-access-ksjdm\") pod \"maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:29.828616 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.828583 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457d380e-4575-44c6-a562-62a6725bccce-maas-api-tls\") pod \"maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:29.830982 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:29.830958 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457d380e-4575-44c6-a562-62a6725bccce-maas-api-tls\") pod \"maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:30.109309 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:30.109182 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:30.257365 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:30.257233 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl"] Jul 02 17:25:30.259765 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:25:30.259724 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457d380e_4575_44c6_a562_62a6725bccce.slice/crio-8600c55612eecd6aaf91ac90050f3030635380ff23f5601be89856355d76b576 WatchSource:0}: Error finding container 8600c55612eecd6aaf91ac90050f3030635380ff23f5601be89856355d76b576: Status 404 returned error can't find the container with id 8600c55612eecd6aaf91ac90050f3030635380ff23f5601be89856355d76b576 Jul 02 17:25:30.805335 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:30.805311 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" event={"ID":"457d380e-4575-44c6-a562-62a6725bccce","Type":"ContainerStarted","Data":"a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3"} Jul 02 17:25:30.805441 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:30.805358 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" event={"ID":"457d380e-4575-44c6-a562-62a6725bccce","Type":"ContainerStarted","Data":"8600c55612eecd6aaf91ac90050f3030635380ff23f5601be89856355d76b576"} Jul 02 17:25:30.805441 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:30.805413 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:30.822187 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:30.822145 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" podStartSLOduration=1.3463156 podStartE2EDuration="1.822127541s" totalImagesPullingTime="475.811941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:25:30.820895936 +0000 UTC m=+1681.374738357" watchObservedRunningTime="2026-07-02 17:25:30.822127541 +0000 UTC m=+1681.375969962" Jul 02 17:25:33.914413 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:33.914381 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl"] Jul 02 17:25:33.914873 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:33.914604 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" podUID="457d380e-4575-44c6-a562-62a6725bccce" containerName="maas-api" containerID="cri-o://a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3" gracePeriod=30 Jul 02 17:25:34.173774 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.173708 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:34.269910 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.269876 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457d380e-4575-44c6-a562-62a6725bccce-maas-api-tls\") pod \"457d380e-4575-44c6-a562-62a6725bccce\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " Jul 02 17:25:34.270083 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.269938 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/457d380e-4575-44c6-a562-62a6725bccce-openshift-service-ca\") pod \"457d380e-4575-44c6-a562-62a6725bccce\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " Jul 02 17:25:34.270083 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.270041 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksjdm\" (UniqueName: \"kubernetes.io/projected/457d380e-4575-44c6-a562-62a6725bccce-kube-api-access-ksjdm\") pod \"457d380e-4575-44c6-a562-62a6725bccce\" (UID: \"457d380e-4575-44c6-a562-62a6725bccce\") " Jul 02 17:25:34.270246 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.270225 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/457d380e-4575-44c6-a562-62a6725bccce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "457d380e-4575-44c6-a562-62a6725bccce" (UID: "457d380e-4575-44c6-a562-62a6725bccce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:25:34.270431 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.270413 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/457d380e-4575-44c6-a562-62a6725bccce-openshift-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:25:34.271961 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.271926 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457d380e-4575-44c6-a562-62a6725bccce-kube-api-access-ksjdm" (OuterVolumeSpecName: "kube-api-access-ksjdm") pod "457d380e-4575-44c6-a562-62a6725bccce" (UID: "457d380e-4575-44c6-a562-62a6725bccce"). InnerVolumeSpecName "kube-api-access-ksjdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:34.271961 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.271941 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/457d380e-4575-44c6-a562-62a6725bccce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "457d380e-4575-44c6-a562-62a6725bccce" (UID: "457d380e-4575-44c6-a562-62a6725bccce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:25:34.371529 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.371498 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/457d380e-4575-44c6-a562-62a6725bccce-maas-api-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:25:34.371529 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.371524 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksjdm\" (UniqueName: \"kubernetes.io/projected/457d380e-4575-44c6-a562-62a6725bccce-kube-api-access-ksjdm\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:25:34.827293 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.827231 2582 generic.go:356] "Generic (PLEG): container finished" podID="457d380e-4575-44c6-a562-62a6725bccce" containerID="a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3" exitCode=0 Jul 02 17:25:34.827493 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.827305 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" Jul 02 17:25:34.827493 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.827321 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" event={"ID":"457d380e-4575-44c6-a562-62a6725bccce","Type":"ContainerDied","Data":"a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3"} Jul 02 17:25:34.827493 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.827372 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl" event={"ID":"457d380e-4575-44c6-a562-62a6725bccce","Type":"ContainerDied","Data":"8600c55612eecd6aaf91ac90050f3030635380ff23f5601be89856355d76b576"} Jul 02 17:25:34.827493 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.827394 2582 scope.go:117] "RemoveContainer" containerID="a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3" Jul 02 17:25:34.836730 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.836715 2582 scope.go:117] "RemoveContainer" containerID="a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3" Jul 02 17:25:34.836999 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:25:34.836981 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3\": container with ID starting with a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3 not found: ID does not exist" containerID="a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3" Jul 02 17:25:34.837052 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.837008 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3"} err="failed to get container status \"a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3\": rpc error: code = NotFound desc = could not find container \"a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3\": container with ID starting with a6bf1e3a67a40faadfe7578cd97316631f3bc95a2070734fc7db7328ebeadbc3 not found: ID does not exist" Jul 02 17:25:34.852679 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.852649 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl"] Jul 02 17:25:34.856504 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:34.856482 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-2dda51e2-64d754f6c7-tggrl"] Jul 02 17:25:35.618295 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:25:35.618252 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="457d380e-4575-44c6-a562-62a6725bccce" path="/var/lib/kubelet/pods/457d380e-4575-44c6-a562-62a6725bccce/volumes" Jul 02 17:27:31.046697 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.046669 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:27:31.051723 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.051702 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:27:31.826719 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.826690 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44"] Jul 02 17:27:31.827185 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.827164 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457d380e-4575-44c6-a562-62a6725bccce" containerName="maas-api" Jul 02 17:27:31.827185 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.827187 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="457d380e-4575-44c6-a562-62a6725bccce" containerName="maas-api" Jul 02 17:27:31.827403 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.827312 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="457d380e-4575-44c6-a562-62a6725bccce" containerName="maas-api" Jul 02 17:27:31.830341 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.830321 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:31.832920 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.832898 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-af630ed9-serving-cert\"" Jul 02 17:27:31.844380 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.844357 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44"] Jul 02 17:27:31.933265 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.933223 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf585\" (UniqueName: \"kubernetes.io/projected/6d0f0e5e-a524-4735-aa7e-f613a8db9071-kube-api-access-vf585\") pod \"maas-api-e2e-mt-af630ed9-7c4df58599-6wh44\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:31.933480 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.933376 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d0f0e5e-a524-4735-aa7e-f613a8db9071-maas-api-tls\") pod \"maas-api-e2e-mt-af630ed9-7c4df58599-6wh44\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:31.933542 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:31.933490 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d0f0e5e-a524-4735-aa7e-f613a8db9071-openshift-service-ca\") pod \"maas-api-e2e-mt-af630ed9-7c4df58599-6wh44\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:32.034227 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:32.034197 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d0f0e5e-a524-4735-aa7e-f613a8db9071-openshift-service-ca\") pod \"maas-api-e2e-mt-af630ed9-7c4df58599-6wh44\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:32.034407 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:32.034247 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf585\" (UniqueName: \"kubernetes.io/projected/6d0f0e5e-a524-4735-aa7e-f613a8db9071-kube-api-access-vf585\") pod \"maas-api-e2e-mt-af630ed9-7c4df58599-6wh44\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:32.034407 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:32.034321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d0f0e5e-a524-4735-aa7e-f613a8db9071-maas-api-tls\") pod \"maas-api-e2e-mt-af630ed9-7c4df58599-6wh44\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:32.034487 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:27:32.034427 2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-af630ed9-serving-cert: secret "maas-api-e2e-mt-af630ed9-serving-cert" not found Jul 02 17:27:32.034487 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:27:32.034480 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0f0e5e-a524-4735-aa7e-f613a8db9071-maas-api-tls podName:6d0f0e5e-a524-4735-aa7e-f613a8db9071 nodeName:}" failed. No retries permitted until 2026-07-02 17:27:32.534464177 +0000 UTC m=+1803.088306575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6d0f0e5e-a524-4735-aa7e-f613a8db9071-maas-api-tls") pod "maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" (UID: "6d0f0e5e-a524-4735-aa7e-f613a8db9071") : secret "maas-api-e2e-mt-af630ed9-serving-cert" not found Jul 02 17:27:32.034815 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:32.034796 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d0f0e5e-a524-4735-aa7e-f613a8db9071-openshift-service-ca\") pod \"maas-api-e2e-mt-af630ed9-7c4df58599-6wh44\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:32.049799 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:32.049771 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf585\" (UniqueName: \"kubernetes.io/projected/6d0f0e5e-a524-4735-aa7e-f613a8db9071-kube-api-access-vf585\") pod \"maas-api-e2e-mt-af630ed9-7c4df58599-6wh44\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:32.538302 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:32.538248 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d0f0e5e-a524-4735-aa7e-f613a8db9071-maas-api-tls\") pod \"maas-api-e2e-mt-af630ed9-7c4df58599-6wh44\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:32.540790 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:32.540766 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d0f0e5e-a524-4735-aa7e-f613a8db9071-maas-api-tls\") pod \"maas-api-e2e-mt-af630ed9-7c4df58599-6wh44\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:32.743979 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:32.743944 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:32.880412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:32.880386 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44"] Jul 02 17:27:32.882314 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:27:32.882264 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d0f0e5e_a524_4735_aa7e_f613a8db9071.slice/crio-47058a888bf74247cd49ed35b8188fa07821db035464dac23592dcb49df27975 WatchSource:0}: Error finding container 47058a888bf74247cd49ed35b8188fa07821db035464dac23592dcb49df27975: Status 404 returned error can't find the container with id 47058a888bf74247cd49ed35b8188fa07821db035464dac23592dcb49df27975 Jul 02 17:27:33.426515 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:33.426487 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" event={"ID":"6d0f0e5e-a524-4735-aa7e-f613a8db9071","Type":"ContainerStarted","Data":"47058a888bf74247cd49ed35b8188fa07821db035464dac23592dcb49df27975"} Jul 02 17:27:34.434209 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:34.434171 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" event={"ID":"6d0f0e5e-a524-4735-aa7e-f613a8db9071","Type":"ContainerStarted","Data":"2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de"} Jul 02 17:27:34.434684 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:34.434331 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:34.451740 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:34.451688 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" podStartSLOduration=2.941751516 podStartE2EDuration="3.451670144s" totalImagesPullingTime="509.918628ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:27:34.450415594 +0000 UTC m=+1805.004258038" watchObservedRunningTime="2026-07-02 17:27:34.451670144 +0000 UTC m=+1805.005512567" Jul 02 17:27:40.444159 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:40.444124 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:43.781869 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:43.781714 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44"] Jul 02 17:27:43.782350 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:43.781973 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" podUID="6d0f0e5e-a524-4735-aa7e-f613a8db9071" containerName="maas-api" containerID="cri-o://2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de" gracePeriod=30 Jul 02 17:27:44.034897 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.034836 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:44.052449 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.052170 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf585\" (UniqueName: \"kubernetes.io/projected/6d0f0e5e-a524-4735-aa7e-f613a8db9071-kube-api-access-vf585\") pod \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " Jul 02 17:27:44.052449 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.052213 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d0f0e5e-a524-4735-aa7e-f613a8db9071-maas-api-tls\") pod \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " Jul 02 17:27:44.052449 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.052382 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d0f0e5e-a524-4735-aa7e-f613a8db9071-openshift-service-ca\") pod \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\" (UID: \"6d0f0e5e-a524-4735-aa7e-f613a8db9071\") " Jul 02 17:27:44.053015 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.052978 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d0f0e5e-a524-4735-aa7e-f613a8db9071-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d0f0e5e-a524-4735-aa7e-f613a8db9071" (UID: "6d0f0e5e-a524-4735-aa7e-f613a8db9071"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:27:44.055144 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.055107 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d0f0e5e-a524-4735-aa7e-f613a8db9071-kube-api-access-vf585" (OuterVolumeSpecName: "kube-api-access-vf585") pod "6d0f0e5e-a524-4735-aa7e-f613a8db9071" (UID: "6d0f0e5e-a524-4735-aa7e-f613a8db9071"). InnerVolumeSpecName "kube-api-access-vf585". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:27:44.056201 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.056168 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d0f0e5e-a524-4735-aa7e-f613a8db9071-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d0f0e5e-a524-4735-aa7e-f613a8db9071" (UID: "6d0f0e5e-a524-4735-aa7e-f613a8db9071"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:27:44.153715 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.153684 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf585\" (UniqueName: \"kubernetes.io/projected/6d0f0e5e-a524-4735-aa7e-f613a8db9071-kube-api-access-vf585\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:27:44.153715 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.153710 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d0f0e5e-a524-4735-aa7e-f613a8db9071-maas-api-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:27:44.153715 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.153720 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d0f0e5e-a524-4735-aa7e-f613a8db9071-openshift-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:27:44.486752 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.486717 2582 generic.go:356] "Generic (PLEG): container finished" podID="6d0f0e5e-a524-4735-aa7e-f613a8db9071" containerID="2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de" exitCode=0 Jul 02 17:27:44.486752 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.486754 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" Jul 02 17:27:44.487007 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.486806 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" event={"ID":"6d0f0e5e-a524-4735-aa7e-f613a8db9071","Type":"ContainerDied","Data":"2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de"} Jul 02 17:27:44.487007 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.486853 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44" event={"ID":"6d0f0e5e-a524-4735-aa7e-f613a8db9071","Type":"ContainerDied","Data":"47058a888bf74247cd49ed35b8188fa07821db035464dac23592dcb49df27975"} Jul 02 17:27:44.487007 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.486879 2582 scope.go:117] "RemoveContainer" containerID="2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de" Jul 02 17:27:44.496259 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.496239 2582 scope.go:117] "RemoveContainer" containerID="2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de" Jul 02 17:27:44.496527 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:27:44.496510 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de\": container with ID starting with 2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de not found: ID does not exist" containerID="2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de" Jul 02 17:27:44.496574 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.496536 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de"} err="failed to get container status \"2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de\": rpc error: code = NotFound desc = could not find container \"2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de\": container with ID starting with 2ad9cac8a22623c270a34125f276ff34ab11e1ba57c45a4d1931998e8bdee9de not found: ID does not exist" Jul 02 17:27:44.508173 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.508148 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44"] Jul 02 17:27:44.512309 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:44.512273 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-af630ed9-7c4df58599-6wh44"] Jul 02 17:27:45.618265 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:27:45.618235 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d0f0e5e-a524-4735-aa7e-f613a8db9071" path="/var/lib/kubelet/pods/6d0f0e5e-a524-4735-aa7e-f613a8db9071/volumes" Jul 02 17:28:12.025029 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.024990 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr"] Jul 02 17:28:12.025672 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.025449 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d0f0e5e-a524-4735-aa7e-f613a8db9071" containerName="maas-api" Jul 02 17:28:12.025672 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.025465 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d0f0e5e-a524-4735-aa7e-f613a8db9071" containerName="maas-api" Jul 02 17:28:12.025672 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.025537 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d0f0e5e-a524-4735-aa7e-f613a8db9071" containerName="maas-api" Jul 02 17:28:12.028870 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.028849 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:12.031487 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.031470 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-ca038502-serving-cert\"" Jul 02 17:28:12.039960 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.039935 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr"] Jul 02 17:28:12.127035 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.126991 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db679af5-1b86-46a2-9404-4e56bd356425-openshift-service-ca\") pod \"maas-api-e2e-mt-ca038502-789c49b4c-8gjpr\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:12.127211 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.127093 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db679af5-1b86-46a2-9404-4e56bd356425-maas-api-tls\") pod \"maas-api-e2e-mt-ca038502-789c49b4c-8gjpr\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:12.127211 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.127123 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mdg9\" (UniqueName: \"kubernetes.io/projected/db679af5-1b86-46a2-9404-4e56bd356425-kube-api-access-8mdg9\") pod \"maas-api-e2e-mt-ca038502-789c49b4c-8gjpr\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:12.228555 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.228516 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db679af5-1b86-46a2-9404-4e56bd356425-openshift-service-ca\") pod \"maas-api-e2e-mt-ca038502-789c49b4c-8gjpr\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:12.228748 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.228580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db679af5-1b86-46a2-9404-4e56bd356425-maas-api-tls\") pod \"maas-api-e2e-mt-ca038502-789c49b4c-8gjpr\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:12.228748 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.228606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mdg9\" (UniqueName: \"kubernetes.io/projected/db679af5-1b86-46a2-9404-4e56bd356425-kube-api-access-8mdg9\") pod \"maas-api-e2e-mt-ca038502-789c49b4c-8gjpr\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:12.229265 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.229244 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db679af5-1b86-46a2-9404-4e56bd356425-openshift-service-ca\") pod \"maas-api-e2e-mt-ca038502-789c49b4c-8gjpr\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:12.230987 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.230965 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db679af5-1b86-46a2-9404-4e56bd356425-maas-api-tls\") pod \"maas-api-e2e-mt-ca038502-789c49b4c-8gjpr\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:12.242742 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.242721 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mdg9\" (UniqueName: \"kubernetes.io/projected/db679af5-1b86-46a2-9404-4e56bd356425-kube-api-access-8mdg9\") pod \"maas-api-e2e-mt-ca038502-789c49b4c-8gjpr\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:12.341273 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.341237 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:12.476854 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.476828 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr"] Jul 02 17:28:12.479229 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:28:12.479192 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb679af5_1b86_46a2_9404_4e56bd356425.slice/crio-b754bc5387d0f9e3b9584d1dec4a64e456ca3cdc655c08296538c367bc94d3c0 WatchSource:0}: Error finding container b754bc5387d0f9e3b9584d1dec4a64e456ca3cdc655c08296538c367bc94d3c0: Status 404 returned error can't find the container with id b754bc5387d0f9e3b9584d1dec4a64e456ca3cdc655c08296538c367bc94d3c0 Jul 02 17:28:12.626697 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:12.626618 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" event={"ID":"db679af5-1b86-46a2-9404-4e56bd356425","Type":"ContainerStarted","Data":"b754bc5387d0f9e3b9584d1dec4a64e456ca3cdc655c08296538c367bc94d3c0"} Jul 02 17:28:13.632665 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:13.632628 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" event={"ID":"db679af5-1b86-46a2-9404-4e56bd356425","Type":"ContainerStarted","Data":"d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b"} Jul 02 17:28:13.633029 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:13.632698 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:13.649975 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:13.649931 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" podStartSLOduration=1.052531368 podStartE2EDuration="1.649916787s" totalImagesPullingTime="597.385419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:28:13.647775296 +0000 UTC m=+1844.201617721" watchObservedRunningTime="2026-07-02 17:28:13.649916787 +0000 UTC m=+1844.203759208" Jul 02 17:28:19.642945 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:19.642917 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:54.109017 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.108932 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr"] Jul 02 17:28:54.109598 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.109172 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" podUID="db679af5-1b86-46a2-9404-4e56bd356425" containerName="maas-api" containerID="cri-o://d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b" gracePeriod=30 Jul 02 17:28:54.366458 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.366398 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:54.533607 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.533575 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mdg9\" (UniqueName: \"kubernetes.io/projected/db679af5-1b86-46a2-9404-4e56bd356425-kube-api-access-8mdg9\") pod \"db679af5-1b86-46a2-9404-4e56bd356425\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " Jul 02 17:28:54.533775 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.533669 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db679af5-1b86-46a2-9404-4e56bd356425-openshift-service-ca\") pod \"db679af5-1b86-46a2-9404-4e56bd356425\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " Jul 02 17:28:54.533775 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.533727 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db679af5-1b86-46a2-9404-4e56bd356425-maas-api-tls\") pod \"db679af5-1b86-46a2-9404-4e56bd356425\" (UID: \"db679af5-1b86-46a2-9404-4e56bd356425\") " Jul 02 17:28:54.534035 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.534003 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db679af5-1b86-46a2-9404-4e56bd356425-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db679af5-1b86-46a2-9404-4e56bd356425" (UID: "db679af5-1b86-46a2-9404-4e56bd356425"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:28:54.535735 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.535702 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db679af5-1b86-46a2-9404-4e56bd356425-kube-api-access-8mdg9" (OuterVolumeSpecName: "kube-api-access-8mdg9") pod "db679af5-1b86-46a2-9404-4e56bd356425" (UID: "db679af5-1b86-46a2-9404-4e56bd356425"). InnerVolumeSpecName "kube-api-access-8mdg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:28:54.535823 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.535761 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db679af5-1b86-46a2-9404-4e56bd356425-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db679af5-1b86-46a2-9404-4e56bd356425" (UID: "db679af5-1b86-46a2-9404-4e56bd356425"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:28:54.634744 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.634666 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db679af5-1b86-46a2-9404-4e56bd356425-openshift-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:28:54.634744 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.634692 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db679af5-1b86-46a2-9404-4e56bd356425-maas-api-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:28:54.634744 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.634702 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mdg9\" (UniqueName: \"kubernetes.io/projected/db679af5-1b86-46a2-9404-4e56bd356425-kube-api-access-8mdg9\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:28:54.842147 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.842109 2582 generic.go:356] "Generic (PLEG): container finished" podID="db679af5-1b86-46a2-9404-4e56bd356425" containerID="d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b" exitCode=0 Jul 02 17:28:54.842353 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.842165 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" Jul 02 17:28:54.842353 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.842183 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" event={"ID":"db679af5-1b86-46a2-9404-4e56bd356425","Type":"ContainerDied","Data":"d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b"} Jul 02 17:28:54.842353 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.842233 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr" event={"ID":"db679af5-1b86-46a2-9404-4e56bd356425","Type":"ContainerDied","Data":"b754bc5387d0f9e3b9584d1dec4a64e456ca3cdc655c08296538c367bc94d3c0"} Jul 02 17:28:54.842353 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.842254 2582 scope.go:117] "RemoveContainer" containerID="d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b" Jul 02 17:28:54.851579 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.851563 2582 scope.go:117] "RemoveContainer" containerID="d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b" Jul 02 17:28:54.851837 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:28:54.851813 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b\": container with ID starting with d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b not found: ID does not exist" containerID="d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b" Jul 02 17:28:54.851888 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.851851 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b"} err="failed to get container status \"d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b\": rpc error: code = NotFound desc = could not find container \"d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b\": container with ID starting with d0e2c69a81c5736106c0d6c93874a997421da7c43bc7f75efa0ab746501c9d3b not found: ID does not exist" Jul 02 17:28:54.863360 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.863339 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr"] Jul 02 17:28:54.866986 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:54.866965 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-ca038502-789c49b4c-8gjpr"] Jul 02 17:28:55.618268 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:28:55.618235 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db679af5-1b86-46a2-9404-4e56bd356425" path="/var/lib/kubelet/pods/db679af5-1b86-46a2-9404-4e56bd356425/volumes" Jul 02 17:30:50.821925 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:50.821894 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq"] Jul 02 17:30:50.822639 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:50.822324 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db679af5-1b86-46a2-9404-4e56bd356425" containerName="maas-api" Jul 02 17:30:50.822639 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:50.822336 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="db679af5-1b86-46a2-9404-4e56bd356425" containerName="maas-api" Jul 02 17:30:50.822639 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:50.822415 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="db679af5-1b86-46a2-9404-4e56bd356425" containerName="maas-api" Jul 02 17:30:50.825558 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:50.825540 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:50.828100 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:50.828080 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-8a6030-serving-cert\"" Jul 02 17:30:50.838386 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:50.838361 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq"] Jul 02 17:30:50.914861 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:50.914826 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:50.915023 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:50.914869 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqgss\" (UniqueName: \"kubernetes.io/projected/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-kube-api-access-mqgss\") pod \"maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:50.915023 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:50.914961 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-maas-api-tls\") pod \"maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:51.016111 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:51.016082 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:51.016111 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:51.016116 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqgss\" (UniqueName: \"kubernetes.io/projected/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-kube-api-access-mqgss\") pod \"maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:51.016343 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:51.016155 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-maas-api-tls\") pod \"maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:51.016777 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:51.016758 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:51.018457 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:51.018438 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-maas-api-tls\") pod \"maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:51.023814 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:51.023788 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqgss\" (UniqueName: \"kubernetes.io/projected/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-kube-api-access-mqgss\") pod \"maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:51.135867 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:51.135798 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:51.270650 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:51.270586 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq"] Jul 02 17:30:51.273105 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:30:51.273077 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a004da_2fa3_4d60_92ac_b64cd5cab4e0.slice/crio-51f64664d3b7e8b6b2bbc6b6c90eb3fce1f022d937519bae7c0932fa14722443 WatchSource:0}: Error finding container 51f64664d3b7e8b6b2bbc6b6c90eb3fce1f022d937519bae7c0932fa14722443: Status 404 returned error can't find the container with id 51f64664d3b7e8b6b2bbc6b6c90eb3fce1f022d937519bae7c0932fa14722443 Jul 02 17:30:51.274365 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:51.274340 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 17:30:51.419074 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:51.418942 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" event={"ID":"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0","Type":"ContainerStarted","Data":"51f64664d3b7e8b6b2bbc6b6c90eb3fce1f022d937519bae7c0932fa14722443"} Jul 02 17:30:52.426069 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:52.426029 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" event={"ID":"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0","Type":"ContainerStarted","Data":"4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4"} Jul 02 17:30:52.426524 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:52.426216 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:52.444626 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:52.444580 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" podStartSLOduration=1.947317725 podStartE2EDuration="2.444565385s" totalImagesPullingTime="497.24766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:30:52.442747895 +0000 UTC m=+2002.996590315" watchObservedRunningTime="2026-07-02 17:30:52.444565385 +0000 UTC m=+2002.998407805" Jul 02 17:30:58.436699 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.436666 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:30:58.745221 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.745145 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh"] Jul 02 17:30:58.749679 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.749659 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:58.752141 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.752115 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-5569c1-serving-cert\"" Jul 02 17:30:58.760114 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.760092 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh"] Jul 02 17:30:58.896308 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.896245 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e15f49b-f0dd-4837-8835-187ade299b4d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:58.896491 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.896324 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5z6l\" (UniqueName: \"kubernetes.io/projected/3e15f49b-f0dd-4837-8835-187ade299b4d-kube-api-access-d5z6l\") pod \"maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:58.896491 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.896351 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e15f49b-f0dd-4837-8835-187ade299b4d-maas-api-tls\") pod \"maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:58.997721 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.997633 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e15f49b-f0dd-4837-8835-187ade299b4d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:58.997721 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.997687 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5z6l\" (UniqueName: \"kubernetes.io/projected/3e15f49b-f0dd-4837-8835-187ade299b4d-kube-api-access-d5z6l\") pod \"maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:58.997721 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.997715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e15f49b-f0dd-4837-8835-187ade299b4d-maas-api-tls\") pod \"maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:58.997997 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:30:58.997919 2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-5569c1-serving-cert: secret "maas-api-e2e-inf-b-5569c1-serving-cert" not found Jul 02 17:30:58.997997 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:30:58.997983 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e15f49b-f0dd-4837-8835-187ade299b4d-maas-api-tls podName:3e15f49b-f0dd-4837-8835-187ade299b4d nodeName:}" failed. No retries permitted until 2026-07-02 17:30:59.497966598 +0000 UTC m=+2010.051808998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3e15f49b-f0dd-4837-8835-187ade299b4d-maas-api-tls") pod "maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" (UID: "3e15f49b-f0dd-4837-8835-187ade299b4d") : secret "maas-api-e2e-inf-b-5569c1-serving-cert" not found Jul 02 17:30:58.998427 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:58.998406 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e15f49b-f0dd-4837-8835-187ade299b4d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:59.006136 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:59.006106 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5z6l\" (UniqueName: \"kubernetes.io/projected/3e15f49b-f0dd-4837-8835-187ade299b4d-kube-api-access-d5z6l\") pod \"maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:59.503618 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:59.503585 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e15f49b-f0dd-4837-8835-187ade299b4d-maas-api-tls\") pod \"maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:59.506078 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:59.506054 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e15f49b-f0dd-4837-8835-187ade299b4d-maas-api-tls\") pod \"maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:59.662695 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:59.662663 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:30:59.799388 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:30:59.799361 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh"] Jul 02 17:30:59.802012 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:30:59.801980 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e15f49b_f0dd_4837_8835_187ade299b4d.slice/crio-6985a3b0d280417d1f4c4e86c9e9dcd8c6761c97b4d5c1455dfa34d4e250116c WatchSource:0}: Error finding container 6985a3b0d280417d1f4c4e86c9e9dcd8c6761c97b4d5c1455dfa34d4e250116c: Status 404 returned error can't find the container with id 6985a3b0d280417d1f4c4e86c9e9dcd8c6761c97b4d5c1455dfa34d4e250116c Jul 02 17:31:00.470815 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:31:00.470781 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" event={"ID":"3e15f49b-f0dd-4837-8835-187ade299b4d","Type":"ContainerStarted","Data":"16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad"} Jul 02 17:31:00.470984 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:31:00.470829 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" event={"ID":"3e15f49b-f0dd-4837-8835-187ade299b4d","Type":"ContainerStarted","Data":"6985a3b0d280417d1f4c4e86c9e9dcd8c6761c97b4d5c1455dfa34d4e250116c"} Jul 02 17:31:00.470984 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:31:00.470972 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:31:00.490768 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:31:00.490716 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" podStartSLOduration=2.003091665 podStartE2EDuration="2.490700946s" totalImagesPullingTime="487.609281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:31:00.488988269 +0000 UTC m=+2011.042830691" watchObservedRunningTime="2026-07-02 17:31:00.490700946 +0000 UTC m=+2011.044543367" Jul 02 17:31:06.483921 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:31:06.483889 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:32:19.018819 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.018733 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq"] Jul 02 17:32:19.019414 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.018976 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" podUID="b8a004da-2fa3-4d60-92ac-b64cd5cab4e0" containerName="maas-api" containerID="cri-o://4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4" gracePeriod=30 Jul 02 17:32:19.274886 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.274829 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:32:19.353697 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.353665 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-maas-api-tls\") pod \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " Jul 02 17:32:19.353871 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.353717 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqgss\" (UniqueName: \"kubernetes.io/projected/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-kube-api-access-mqgss\") pod \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " Jul 02 17:32:19.353871 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.353841 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-openshift-service-ca\") pod \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\" (UID: \"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0\") " Jul 02 17:32:19.354166 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.354142 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b8a004da-2fa3-4d60-92ac-b64cd5cab4e0" (UID: "b8a004da-2fa3-4d60-92ac-b64cd5cab4e0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:32:19.355803 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.355768 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b8a004da-2fa3-4d60-92ac-b64cd5cab4e0" (UID: "b8a004da-2fa3-4d60-92ac-b64cd5cab4e0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:32:19.355912 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.355825 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-kube-api-access-mqgss" (OuterVolumeSpecName: "kube-api-access-mqgss") pod "b8a004da-2fa3-4d60-92ac-b64cd5cab4e0" (UID: "b8a004da-2fa3-4d60-92ac-b64cd5cab4e0"). InnerVolumeSpecName "kube-api-access-mqgss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:32:19.454696 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.454665 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-maas-api-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:32:19.454696 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.454690 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqgss\" (UniqueName: \"kubernetes.io/projected/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-kube-api-access-mqgss\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:32:19.454696 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.454702 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0-openshift-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:32:19.876986 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.876892 2582 generic.go:356] "Generic (PLEG): container finished" podID="b8a004da-2fa3-4d60-92ac-b64cd5cab4e0" containerID="4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4" exitCode=0 Jul 02 17:32:19.876986 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.876933 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" Jul 02 17:32:19.876986 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.876944 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" event={"ID":"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0","Type":"ContainerDied","Data":"4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4"} Jul 02 17:32:19.877230 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.876992 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq" event={"ID":"b8a004da-2fa3-4d60-92ac-b64cd5cab4e0","Type":"ContainerDied","Data":"51f64664d3b7e8b6b2bbc6b6c90eb3fce1f022d937519bae7c0932fa14722443"} Jul 02 17:32:19.877230 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.877025 2582 scope.go:117] "RemoveContainer" containerID="4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4" Jul 02 17:32:19.885813 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.885799 2582 scope.go:117] "RemoveContainer" containerID="4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4" Jul 02 17:32:19.886080 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:32:19.886058 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4\": container with ID starting with 4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4 not found: ID does not exist" containerID="4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4" Jul 02 17:32:19.886128 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.886090 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4"} err="failed to get container status \"4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4\": rpc error: code = NotFound desc = could not find container \"4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4\": container with ID starting with 4c033974e8962efb0853f69d4c0e84f41f8d0e7bfdcf00e91a9065c05424fbe4 not found: ID does not exist" Jul 02 17:32:19.893847 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.893825 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq"] Jul 02 17:32:19.898088 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:19.898070 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8a6030-7b7dfc7f9f-w9rtq"] Jul 02 17:32:21.618851 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:21.618822 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8a004da-2fa3-4d60-92ac-b64cd5cab4e0" path="/var/lib/kubelet/pods/b8a004da-2fa3-4d60-92ac-b64cd5cab4e0/volumes" Jul 02 17:32:31.079671 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:31.079642 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:32:31.085980 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:32:31.085962 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:33:02.086581 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.086544 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh"] Jul 02 17:33:02.087201 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.086780 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" podUID="3e15f49b-f0dd-4837-8835-187ade299b4d" containerName="maas-api" containerID="cri-o://16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad" gracePeriod=30 Jul 02 17:33:02.349213 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.349151 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:33:02.466873 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.466841 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5z6l\" (UniqueName: \"kubernetes.io/projected/3e15f49b-f0dd-4837-8835-187ade299b4d-kube-api-access-d5z6l\") pod \"3e15f49b-f0dd-4837-8835-187ade299b4d\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " Jul 02 17:33:02.467055 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.466948 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e15f49b-f0dd-4837-8835-187ade299b4d-maas-api-tls\") pod \"3e15f49b-f0dd-4837-8835-187ade299b4d\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " Jul 02 17:33:02.467055 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.467007 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e15f49b-f0dd-4837-8835-187ade299b4d-openshift-service-ca\") pod \"3e15f49b-f0dd-4837-8835-187ade299b4d\" (UID: \"3e15f49b-f0dd-4837-8835-187ade299b4d\") " Jul 02 17:33:02.467459 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.467432 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e15f49b-f0dd-4837-8835-187ade299b4d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3e15f49b-f0dd-4837-8835-187ade299b4d" (UID: "3e15f49b-f0dd-4837-8835-187ade299b4d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:33:02.468987 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.468958 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e15f49b-f0dd-4837-8835-187ade299b4d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3e15f49b-f0dd-4837-8835-187ade299b4d" (UID: "3e15f49b-f0dd-4837-8835-187ade299b4d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:33:02.469081 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.469016 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e15f49b-f0dd-4837-8835-187ade299b4d-kube-api-access-d5z6l" (OuterVolumeSpecName: "kube-api-access-d5z6l") pod "3e15f49b-f0dd-4837-8835-187ade299b4d" (UID: "3e15f49b-f0dd-4837-8835-187ade299b4d"). InnerVolumeSpecName "kube-api-access-d5z6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:02.568531 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.568499 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e15f49b-f0dd-4837-8835-187ade299b4d-openshift-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:33:02.568531 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.568526 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5z6l\" (UniqueName: \"kubernetes.io/projected/3e15f49b-f0dd-4837-8835-187ade299b4d-kube-api-access-d5z6l\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:33:02.568531 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:02.568536 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e15f49b-f0dd-4837-8835-187ade299b4d-maas-api-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:33:03.094177 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:03.094146 2582 generic.go:356] "Generic (PLEG): container finished" podID="3e15f49b-f0dd-4837-8835-187ade299b4d" containerID="16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad" exitCode=0 Jul 02 17:33:03.094626 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:03.094190 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" Jul 02 17:33:03.094626 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:03.094230 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" event={"ID":"3e15f49b-f0dd-4837-8835-187ade299b4d","Type":"ContainerDied","Data":"16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad"} Jul 02 17:33:03.094626 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:03.094307 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh" event={"ID":"3e15f49b-f0dd-4837-8835-187ade299b4d","Type":"ContainerDied","Data":"6985a3b0d280417d1f4c4e86c9e9dcd8c6761c97b4d5c1455dfa34d4e250116c"} Jul 02 17:33:03.094626 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:03.094330 2582 scope.go:117] "RemoveContainer" containerID="16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad" Jul 02 17:33:03.103645 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:03.103625 2582 scope.go:117] "RemoveContainer" containerID="16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad" Jul 02 17:33:03.103906 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:33:03.103890 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad\": container with ID starting with 16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad not found: ID does not exist" containerID="16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad" Jul 02 17:33:03.103955 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:03.103915 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad"} err="failed to get container status \"16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad\": rpc error: code = NotFound desc = could not find container \"16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad\": container with ID starting with 16540e89cc9bb88db2f388d338dc7035a4b514956b2fe3a14b27ddffb73cecad not found: ID does not exist" Jul 02 17:33:03.115921 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:03.115895 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh"] Jul 02 17:33:03.117768 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:03.117743 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5569c1-85f84ccdd9-xzblh"] Jul 02 17:33:03.618002 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:03.617961 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e15f49b-f0dd-4837-8835-187ade299b4d" path="/var/lib/kubelet/pods/3e15f49b-f0dd-4837-8835-187ade299b4d/volumes" Jul 02 17:33:11.577200 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.577163 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg"] Jul 02 17:33:11.577854 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.577834 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8a004da-2fa3-4d60-92ac-b64cd5cab4e0" containerName="maas-api" Jul 02 17:33:11.577902 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.577860 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8a004da-2fa3-4d60-92ac-b64cd5cab4e0" containerName="maas-api" Jul 02 17:33:11.577902 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.577873 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e15f49b-f0dd-4837-8835-187ade299b4d" containerName="maas-api" Jul 02 17:33:11.577902 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.577882 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e15f49b-f0dd-4837-8835-187ade299b4d" containerName="maas-api" Jul 02 17:33:11.578011 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.577979 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e15f49b-f0dd-4837-8835-187ade299b4d" containerName="maas-api" Jul 02 17:33:11.578011 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.577995 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8a004da-2fa3-4d60-92ac-b64cd5cab4e0" containerName="maas-api" Jul 02 17:33:11.581677 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.581655 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:11.584155 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.584126 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-f10fdf-serving-cert\"" Jul 02 17:33:11.590378 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.590355 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg"] Jul 02 17:33:11.652014 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.651986 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ce78f94-501e-43bb-9aab-90ddac3635bd-maas-api-tls\") pod \"maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:11.652014 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.652021 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n28b4\" (UniqueName: \"kubernetes.io/projected/0ce78f94-501e-43bb-9aab-90ddac3635bd-kube-api-access-n28b4\") pod \"maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:11.652312 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.652103 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce78f94-501e-43bb-9aab-90ddac3635bd-openshift-service-ca\") pod \"maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:11.752750 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.752711 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ce78f94-501e-43bb-9aab-90ddac3635bd-maas-api-tls\") pod \"maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:11.752960 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.752769 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28b4\" (UniqueName: \"kubernetes.io/projected/0ce78f94-501e-43bb-9aab-90ddac3635bd-kube-api-access-n28b4\") pod \"maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:11.752960 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.752847 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce78f94-501e-43bb-9aab-90ddac3635bd-openshift-service-ca\") pod \"maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:11.753649 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.753621 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce78f94-501e-43bb-9aab-90ddac3635bd-openshift-service-ca\") pod \"maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:11.755215 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.755190 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ce78f94-501e-43bb-9aab-90ddac3635bd-maas-api-tls\") pod \"maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:11.762025 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.762003 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n28b4\" (UniqueName: \"kubernetes.io/projected/0ce78f94-501e-43bb-9aab-90ddac3635bd-kube-api-access-n28b4\") pod \"maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:11.893894 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:11.893807 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:12.047958 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:12.047925 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg"] Jul 02 17:33:12.051895 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:33:12.051857 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce78f94_501e_43bb_9aab_90ddac3635bd.slice/crio-42c0b68fecece5141bd437d0070c56b566853e4cd7d9fba0a7be8f030967c0d4 WatchSource:0}: Error finding container 42c0b68fecece5141bd437d0070c56b566853e4cd7d9fba0a7be8f030967c0d4: Status 404 returned error can't find the container with id 42c0b68fecece5141bd437d0070c56b566853e4cd7d9fba0a7be8f030967c0d4 Jul 02 17:33:12.141085 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:12.141052 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" event={"ID":"0ce78f94-501e-43bb-9aab-90ddac3635bd","Type":"ContainerStarted","Data":"42c0b68fecece5141bd437d0070c56b566853e4cd7d9fba0a7be8f030967c0d4"} Jul 02 17:33:13.148741 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:13.148698 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" event={"ID":"0ce78f94-501e-43bb-9aab-90ddac3635bd","Type":"ContainerStarted","Data":"9f13c1110647d57b48477c39504ada890d515fa6171c49394b30b13ee828e263"} Jul 02 17:33:13.149228 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:13.148850 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:13.166616 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:13.166570 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" podStartSLOduration=1.7491726189999999 podStartE2EDuration="2.166554409s" totalImagesPullingTime="417.38179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:33:13.165027362 +0000 UTC m=+2143.718869778" watchObservedRunningTime="2026-07-02 17:33:13.166554409 +0000 UTC m=+2143.720396829" Jul 02 17:33:19.161615 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.161583 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:19.552049 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.551963 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp"] Jul 02 17:33:19.556431 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.556407 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:19.559406 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.559380 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-9cdf01-serving-cert\"" Jul 02 17:33:19.570796 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.570764 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp"] Jul 02 17:33:19.627773 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.627739 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b78061c3-b027-4a81-8289-7ae3eca688e7-maas-api-tls\") pod \"maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:19.627914 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.627786 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b78061c3-b027-4a81-8289-7ae3eca688e7-openshift-service-ca\") pod \"maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:19.627975 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.627931 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf99v\" (UniqueName: \"kubernetes.io/projected/b78061c3-b027-4a81-8289-7ae3eca688e7-kube-api-access-sf99v\") pod \"maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:19.728616 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.728583 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b78061c3-b027-4a81-8289-7ae3eca688e7-maas-api-tls\") pod \"maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:19.728787 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.728627 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b78061c3-b027-4a81-8289-7ae3eca688e7-openshift-service-ca\") pod \"maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:19.728787 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:33:19.728724 2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-9cdf01-serving-cert: secret "maas-api-e2e-api-b-9cdf01-serving-cert" not found Jul 02 17:33:19.728787 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:33:19.728779 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78061c3-b027-4a81-8289-7ae3eca688e7-maas-api-tls podName:b78061c3-b027-4a81-8289-7ae3eca688e7 nodeName:}" failed. No retries permitted until 2026-07-02 17:33:20.228762551 +0000 UTC m=+2150.782604950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b78061c3-b027-4a81-8289-7ae3eca688e7-maas-api-tls") pod "maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" (UID: "b78061c3-b027-4a81-8289-7ae3eca688e7") : secret "maas-api-e2e-api-b-9cdf01-serving-cert" not found Jul 02 17:33:19.728976 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.728891 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf99v\" (UniqueName: \"kubernetes.io/projected/b78061c3-b027-4a81-8289-7ae3eca688e7-kube-api-access-sf99v\") pod \"maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:19.729212 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.729196 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b78061c3-b027-4a81-8289-7ae3eca688e7-openshift-service-ca\") pod \"maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:19.737383 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:19.737361 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf99v\" (UniqueName: \"kubernetes.io/projected/b78061c3-b027-4a81-8289-7ae3eca688e7-kube-api-access-sf99v\") pod \"maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:20.233040 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:20.233002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b78061c3-b027-4a81-8289-7ae3eca688e7-maas-api-tls\") pod \"maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:20.235471 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:20.235445 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b78061c3-b027-4a81-8289-7ae3eca688e7-maas-api-tls\") pod \"maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:20.469469 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:20.469432 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:20.617585 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:20.617550 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp"] Jul 02 17:33:20.621062 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:33:20.621036 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78061c3_b027_4a81_8289_7ae3eca688e7.slice/crio-354ed7f35cdd328be433d34eade1260085214af2ad89e04c4423dcef81b0a3d1 WatchSource:0}: Error finding container 354ed7f35cdd328be433d34eade1260085214af2ad89e04c4423dcef81b0a3d1: Status 404 returned error can't find the container with id 354ed7f35cdd328be433d34eade1260085214af2ad89e04c4423dcef81b0a3d1 Jul 02 17:33:21.193105 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:21.193067 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" event={"ID":"b78061c3-b027-4a81-8289-7ae3eca688e7","Type":"ContainerStarted","Data":"f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6"} Jul 02 17:33:21.193323 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:21.193150 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" event={"ID":"b78061c3-b027-4a81-8289-7ae3eca688e7","Type":"ContainerStarted","Data":"354ed7f35cdd328be433d34eade1260085214af2ad89e04c4423dcef81b0a3d1"} Jul 02 17:33:21.193323 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:21.193264 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:21.209363 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:21.209311 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" podStartSLOduration=1.8261841479999998 podStartE2EDuration="2.209270782s" totalImagesPullingTime="383.086634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:33:21.208980698 +0000 UTC m=+2151.762823120" watchObservedRunningTime="2026-07-02 17:33:21.209270782 +0000 UTC m=+2151.763113204" Jul 02 17:33:27.204481 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:27.204407 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:33.082406 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.082368 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg"] Jul 02 17:33:33.082889 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.082583 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" podUID="0ce78f94-501e-43bb-9aab-90ddac3635bd" containerName="maas-api" containerID="cri-o://9f13c1110647d57b48477c39504ada890d515fa6171c49394b30b13ee828e263" gracePeriod=30 Jul 02 17:33:33.255462 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.255429 2582 generic.go:356] "Generic (PLEG): container finished" podID="0ce78f94-501e-43bb-9aab-90ddac3635bd" containerID="9f13c1110647d57b48477c39504ada890d515fa6171c49394b30b13ee828e263" exitCode=0 Jul 02 17:33:33.255600 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.255485 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" event={"ID":"0ce78f94-501e-43bb-9aab-90ddac3635bd","Type":"ContainerDied","Data":"9f13c1110647d57b48477c39504ada890d515fa6171c49394b30b13ee828e263"} Jul 02 17:33:33.333136 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.333080 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:33.469835 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.469805 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n28b4\" (UniqueName: \"kubernetes.io/projected/0ce78f94-501e-43bb-9aab-90ddac3635bd-kube-api-access-n28b4\") pod \"0ce78f94-501e-43bb-9aab-90ddac3635bd\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " Jul 02 17:33:33.470013 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.469860 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ce78f94-501e-43bb-9aab-90ddac3635bd-maas-api-tls\") pod \"0ce78f94-501e-43bb-9aab-90ddac3635bd\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " Jul 02 17:33:33.470013 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.469886 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce78f94-501e-43bb-9aab-90ddac3635bd-openshift-service-ca\") pod \"0ce78f94-501e-43bb-9aab-90ddac3635bd\" (UID: \"0ce78f94-501e-43bb-9aab-90ddac3635bd\") " Jul 02 17:33:33.470318 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.470262 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce78f94-501e-43bb-9aab-90ddac3635bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ce78f94-501e-43bb-9aab-90ddac3635bd" (UID: "0ce78f94-501e-43bb-9aab-90ddac3635bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:33:33.472012 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.471982 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce78f94-501e-43bb-9aab-90ddac3635bd-kube-api-access-n28b4" (OuterVolumeSpecName: "kube-api-access-n28b4") pod "0ce78f94-501e-43bb-9aab-90ddac3635bd" (UID: "0ce78f94-501e-43bb-9aab-90ddac3635bd"). InnerVolumeSpecName "kube-api-access-n28b4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:33.472012 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.472001 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce78f94-501e-43bb-9aab-90ddac3635bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ce78f94-501e-43bb-9aab-90ddac3635bd" (UID: "0ce78f94-501e-43bb-9aab-90ddac3635bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:33:33.570734 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.570706 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n28b4\" (UniqueName: \"kubernetes.io/projected/0ce78f94-501e-43bb-9aab-90ddac3635bd-kube-api-access-n28b4\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:33:33.570734 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.570733 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ce78f94-501e-43bb-9aab-90ddac3635bd-maas-api-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:33:33.570734 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:33.570742 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce78f94-501e-43bb-9aab-90ddac3635bd-openshift-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:33:34.262434 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:34.262403 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" Jul 02 17:33:34.262889 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:34.262432 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg" event={"ID":"0ce78f94-501e-43bb-9aab-90ddac3635bd","Type":"ContainerDied","Data":"42c0b68fecece5141bd437d0070c56b566853e4cd7d9fba0a7be8f030967c0d4"} Jul 02 17:33:34.262889 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:34.262508 2582 scope.go:117] "RemoveContainer" containerID="9f13c1110647d57b48477c39504ada890d515fa6171c49394b30b13ee828e263" Jul 02 17:33:34.279369 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:34.279346 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg"] Jul 02 17:33:34.299348 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:34.299323 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f10fdf-6cc886665c-bmddg"] Jul 02 17:33:35.618376 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:35.618341 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ce78f94-501e-43bb-9aab-90ddac3635bd" path="/var/lib/kubelet/pods/0ce78f94-501e-43bb-9aab-90ddac3635bd/volumes" Jul 02 17:33:39.807269 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:39.807235 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp"] Jul 02 17:33:39.807759 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:39.807468 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" podUID="b78061c3-b027-4a81-8289-7ae3eca688e7" containerName="maas-api" containerID="cri-o://f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6" gracePeriod=30 Jul 02 17:33:40.061886 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.061812 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:40.236833 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.236799 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b78061c3-b027-4a81-8289-7ae3eca688e7-openshift-service-ca\") pod \"b78061c3-b027-4a81-8289-7ae3eca688e7\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " Jul 02 17:33:40.236993 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.236893 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf99v\" (UniqueName: \"kubernetes.io/projected/b78061c3-b027-4a81-8289-7ae3eca688e7-kube-api-access-sf99v\") pod \"b78061c3-b027-4a81-8289-7ae3eca688e7\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " Jul 02 17:33:40.236993 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.236937 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b78061c3-b027-4a81-8289-7ae3eca688e7-maas-api-tls\") pod \"b78061c3-b027-4a81-8289-7ae3eca688e7\" (UID: \"b78061c3-b027-4a81-8289-7ae3eca688e7\") " Jul 02 17:33:40.237154 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.237132 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b78061c3-b027-4a81-8289-7ae3eca688e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b78061c3-b027-4a81-8289-7ae3eca688e7" (UID: "b78061c3-b027-4a81-8289-7ae3eca688e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:33:40.237310 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.237267 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b78061c3-b027-4a81-8289-7ae3eca688e7-openshift-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:33:40.238910 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.238888 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b78061c3-b027-4a81-8289-7ae3eca688e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b78061c3-b027-4a81-8289-7ae3eca688e7" (UID: "b78061c3-b027-4a81-8289-7ae3eca688e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:33:40.239060 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.239037 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b78061c3-b027-4a81-8289-7ae3eca688e7-kube-api-access-sf99v" (OuterVolumeSpecName: "kube-api-access-sf99v") pod "b78061c3-b027-4a81-8289-7ae3eca688e7" (UID: "b78061c3-b027-4a81-8289-7ae3eca688e7"). InnerVolumeSpecName "kube-api-access-sf99v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:40.295097 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.295066 2582 generic.go:356] "Generic (PLEG): container finished" podID="b78061c3-b027-4a81-8289-7ae3eca688e7" containerID="f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6" exitCode=0 Jul 02 17:33:40.295244 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.295119 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" Jul 02 17:33:40.295244 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.295153 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" event={"ID":"b78061c3-b027-4a81-8289-7ae3eca688e7","Type":"ContainerDied","Data":"f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6"} Jul 02 17:33:40.295244 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.295204 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp" event={"ID":"b78061c3-b027-4a81-8289-7ae3eca688e7","Type":"ContainerDied","Data":"354ed7f35cdd328be433d34eade1260085214af2ad89e04c4423dcef81b0a3d1"} Jul 02 17:33:40.295244 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.295229 2582 scope.go:117] "RemoveContainer" containerID="f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6" Jul 02 17:33:40.305428 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.305410 2582 scope.go:117] "RemoveContainer" containerID="f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6" Jul 02 17:33:40.305658 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:33:40.305636 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6\": container with ID starting with f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6 not found: ID does not exist" containerID="f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6" Jul 02 17:33:40.305730 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.305670 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6"} err="failed to get container status \"f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6\": rpc error: code = NotFound desc = could not find container \"f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6\": container with ID starting with f34b9b950da3c23c3edbe656a70339c33cde0e371546244b3f332971e52721c6 not found: ID does not exist" Jul 02 17:33:40.320012 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.319950 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp"] Jul 02 17:33:40.323649 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.323628 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9cdf01-576cd49fdd-xltwp"] Jul 02 17:33:40.338195 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.338173 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf99v\" (UniqueName: \"kubernetes.io/projected/b78061c3-b027-4a81-8289-7ae3eca688e7-kube-api-access-sf99v\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:33:40.338195 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:40.338193 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b78061c3-b027-4a81-8289-7ae3eca688e7-maas-api-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:33:41.619027 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:41.618993 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b78061c3-b027-4a81-8289-7ae3eca688e7" path="/var/lib/kubelet/pods/b78061c3-b027-4a81-8289-7ae3eca688e7/volumes" Jul 02 17:33:49.839565 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.839530 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z"] Jul 02 17:33:49.840035 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.839920 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce78f94-501e-43bb-9aab-90ddac3635bd" containerName="maas-api" Jul 02 17:33:49.840035 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.839931 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce78f94-501e-43bb-9aab-90ddac3635bd" containerName="maas-api" Jul 02 17:33:49.840035 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.839945 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b78061c3-b027-4a81-8289-7ae3eca688e7" containerName="maas-api" Jul 02 17:33:49.840035 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.839950 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b78061c3-b027-4a81-8289-7ae3eca688e7" containerName="maas-api" Jul 02 17:33:49.840035 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.840021 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ce78f94-501e-43bb-9aab-90ddac3635bd" containerName="maas-api" Jul 02 17:33:49.840035 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.840030 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b78061c3-b027-4a81-8289-7ae3eca688e7" containerName="maas-api" Jul 02 17:33:49.844530 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.844509 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:49.847110 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.847086 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-0e06fb-serving-cert\"" Jul 02 17:33:49.853814 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.853787 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z"] Jul 02 17:33:49.928353 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.928309 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/108ae400-3f9b-4804-b83b-d64b0f4e2c25-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:49.928515 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.928397 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108ae400-3f9b-4804-b83b-d64b0f4e2c25-maas-api-tls\") pod \"maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:49.928515 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:49.928424 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f9fn\" (UniqueName: \"kubernetes.io/projected/108ae400-3f9b-4804-b83b-d64b0f4e2c25-kube-api-access-4f9fn\") pod \"maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:50.030079 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:50.030041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/108ae400-3f9b-4804-b83b-d64b0f4e2c25-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:50.030250 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:50.030142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108ae400-3f9b-4804-b83b-d64b0f4e2c25-maas-api-tls\") pod \"maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:50.030250 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:50.030184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f9fn\" (UniqueName: \"kubernetes.io/projected/108ae400-3f9b-4804-b83b-d64b0f4e2c25-kube-api-access-4f9fn\") pod \"maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:50.030361 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:33:50.030325 2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-0e06fb-serving-cert: secret "maas-api-e2e-shared-a-0e06fb-serving-cert" not found Jul 02 17:33:50.030411 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:33:50.030400 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/108ae400-3f9b-4804-b83b-d64b0f4e2c25-maas-api-tls podName:108ae400-3f9b-4804-b83b-d64b0f4e2c25 nodeName:}" failed. No retries permitted until 2026-07-02 17:33:50.530381306 +0000 UTC m=+2181.084223705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/108ae400-3f9b-4804-b83b-d64b0f4e2c25-maas-api-tls") pod "maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" (UID: "108ae400-3f9b-4804-b83b-d64b0f4e2c25") : secret "maas-api-e2e-shared-a-0e06fb-serving-cert" not found Jul 02 17:33:50.030815 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:50.030797 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/108ae400-3f9b-4804-b83b-d64b0f4e2c25-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:50.039046 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:50.039025 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f9fn\" (UniqueName: \"kubernetes.io/projected/108ae400-3f9b-4804-b83b-d64b0f4e2c25-kube-api-access-4f9fn\") pod \"maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:50.534595 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:50.534560 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108ae400-3f9b-4804-b83b-d64b0f4e2c25-maas-api-tls\") pod \"maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:50.536921 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:50.536901 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108ae400-3f9b-4804-b83b-d64b0f4e2c25-maas-api-tls\") pod \"maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:50.758288 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:50.758235 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:50.910489 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:50.910461 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z"] Jul 02 17:33:50.913717 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:33:50.913688 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod108ae400_3f9b_4804_b83b_d64b0f4e2c25.slice/crio-25690082889d1e9736a1c8c193a9c60035483cbf71cfada4eb354b03276a8142 WatchSource:0}: Error finding container 25690082889d1e9736a1c8c193a9c60035483cbf71cfada4eb354b03276a8142: Status 404 returned error can't find the container with id 25690082889d1e9736a1c8c193a9c60035483cbf71cfada4eb354b03276a8142 Jul 02 17:33:51.352090 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:51.352059 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" event={"ID":"108ae400-3f9b-4804-b83b-d64b0f4e2c25","Type":"ContainerStarted","Data":"2d84c08e9b1f9aede5eee2ed5243331af305f387d3926497e8b5d02d0c2319d8"} Jul 02 17:33:51.352206 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:51.352112 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" event={"ID":"108ae400-3f9b-4804-b83b-d64b0f4e2c25","Type":"ContainerStarted","Data":"25690082889d1e9736a1c8c193a9c60035483cbf71cfada4eb354b03276a8142"} Jul 02 17:33:51.352206 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:51.352166 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:51.370255 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:51.370210 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" podStartSLOduration=2.003783125 podStartE2EDuration="2.370194993s" totalImagesPullingTime="366.411868ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:33:51.368578622 +0000 UTC m=+2181.922421054" watchObservedRunningTime="2026-07-02 17:33:51.370194993 +0000 UTC m=+2181.924037414" Jul 02 17:33:57.362542 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:57.362511 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:33:57.909530 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:57.909497 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8"] Jul 02 17:33:57.913294 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:57.913262 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:57.915886 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:57.915862 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-d87672-serving-cert\"" Jul 02 17:33:57.925558 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:57.925532 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8"] Jul 02 17:33:58.009231 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.009197 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0388e43a-6b76-4667-bde1-2ea7bb480bf3-maas-api-tls\") pod \"maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:58.009412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.009237 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0388e43a-6b76-4667-bde1-2ea7bb480bf3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:58.009412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.009329 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpm7g\" (UniqueName: \"kubernetes.io/projected/0388e43a-6b76-4667-bde1-2ea7bb480bf3-kube-api-access-gpm7g\") pod \"maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:58.110059 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.110029 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0388e43a-6b76-4667-bde1-2ea7bb480bf3-maas-api-tls\") pod \"maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:58.110209 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.110063 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0388e43a-6b76-4667-bde1-2ea7bb480bf3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:58.110209 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.110124 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpm7g\" (UniqueName: \"kubernetes.io/projected/0388e43a-6b76-4667-bde1-2ea7bb480bf3-kube-api-access-gpm7g\") pod \"maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:58.110790 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.110763 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0388e43a-6b76-4667-bde1-2ea7bb480bf3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:58.112517 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.112497 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0388e43a-6b76-4667-bde1-2ea7bb480bf3-maas-api-tls\") pod \"maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:58.123692 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.123666 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpm7g\" (UniqueName: \"kubernetes.io/projected/0388e43a-6b76-4667-bde1-2ea7bb480bf3-kube-api-access-gpm7g\") pod \"maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:58.227703 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.227625 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:58.369537 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.369511 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8"] Jul 02 17:33:58.371661 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:33:58.371630 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0388e43a_6b76_4667_bde1_2ea7bb480bf3.slice/crio-d0c51ea65623488a71495c12cc25e78b56ccd5738ffda8362928c2686165ddcc WatchSource:0}: Error finding container d0c51ea65623488a71495c12cc25e78b56ccd5738ffda8362928c2686165ddcc: Status 404 returned error can't find the container with id d0c51ea65623488a71495c12cc25e78b56ccd5738ffda8362928c2686165ddcc Jul 02 17:33:58.389773 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:58.389749 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" event={"ID":"0388e43a-6b76-4667-bde1-2ea7bb480bf3","Type":"ContainerStarted","Data":"d0c51ea65623488a71495c12cc25e78b56ccd5738ffda8362928c2686165ddcc"} Jul 02 17:33:59.395933 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:59.395898 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" event={"ID":"0388e43a-6b76-4667-bde1-2ea7bb480bf3","Type":"ContainerStarted","Data":"9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7"} Jul 02 17:33:59.396426 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:59.395966 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:33:59.418065 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:33:59.418009 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" podStartSLOduration=2.081361777 podStartE2EDuration="2.417993796s" totalImagesPullingTime="336.632019ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:33:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:33:59.416143178 +0000 UTC m=+2189.969985600" watchObservedRunningTime="2026-07-02 17:33:59.417993796 +0000 UTC m=+2189.971836242" Jul 02 17:34:05.407044 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:34:05.407017 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:37:31.113701 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:37:31.113675 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:37:31.119665 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:37:31.119646 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h47wm_03c56d11-4b60-4145-9d95-4bed2230614c/ovn-acl-logging/0.log" Jul 02 17:40:11.053677 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.053643 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z"] Jul 02 17:40:11.054465 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.054431 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" podUID="108ae400-3f9b-4804-b83b-d64b0f4e2c25" containerName="maas-api" containerID="cri-o://2d84c08e9b1f9aede5eee2ed5243331af305f387d3926497e8b5d02d0c2319d8" gracePeriod=30 Jul 02 17:40:11.252662 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.252627 2582 generic.go:356] "Generic (PLEG): container finished" podID="108ae400-3f9b-4804-b83b-d64b0f4e2c25" containerID="2d84c08e9b1f9aede5eee2ed5243331af305f387d3926497e8b5d02d0c2319d8" exitCode=0 Jul 02 17:40:11.252826 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.252700 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" event={"ID":"108ae400-3f9b-4804-b83b-d64b0f4e2c25","Type":"ContainerDied","Data":"2d84c08e9b1f9aede5eee2ed5243331af305f387d3926497e8b5d02d0c2319d8"} Jul 02 17:40:11.302547 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.302523 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:40:11.385816 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.385785 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108ae400-3f9b-4804-b83b-d64b0f4e2c25-maas-api-tls\") pod \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " Jul 02 17:40:11.385816 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.385823 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f9fn\" (UniqueName: \"kubernetes.io/projected/108ae400-3f9b-4804-b83b-d64b0f4e2c25-kube-api-access-4f9fn\") pod \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " Jul 02 17:40:11.386073 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.385920 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/108ae400-3f9b-4804-b83b-d64b0f4e2c25-openshift-service-ca\") pod \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\" (UID: \"108ae400-3f9b-4804-b83b-d64b0f4e2c25\") " Jul 02 17:40:11.386289 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.386247 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/108ae400-3f9b-4804-b83b-d64b0f4e2c25-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "108ae400-3f9b-4804-b83b-d64b0f4e2c25" (UID: "108ae400-3f9b-4804-b83b-d64b0f4e2c25"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:40:11.387904 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.387882 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/108ae400-3f9b-4804-b83b-d64b0f4e2c25-kube-api-access-4f9fn" (OuterVolumeSpecName: "kube-api-access-4f9fn") pod "108ae400-3f9b-4804-b83b-d64b0f4e2c25" (UID: "108ae400-3f9b-4804-b83b-d64b0f4e2c25"). InnerVolumeSpecName "kube-api-access-4f9fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:40:11.387979 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.387893 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/108ae400-3f9b-4804-b83b-d64b0f4e2c25-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "108ae400-3f9b-4804-b83b-d64b0f4e2c25" (UID: "108ae400-3f9b-4804-b83b-d64b0f4e2c25"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:40:11.487339 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.487306 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/108ae400-3f9b-4804-b83b-d64b0f4e2c25-openshift-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:40:11.487339 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.487336 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108ae400-3f9b-4804-b83b-d64b0f4e2c25-maas-api-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:40:11.487339 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:11.487346 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f9fn\" (UniqueName: \"kubernetes.io/projected/108ae400-3f9b-4804-b83b-d64b0f4e2c25-kube-api-access-4f9fn\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:40:12.258575 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:12.258543 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" event={"ID":"108ae400-3f9b-4804-b83b-d64b0f4e2c25","Type":"ContainerDied","Data":"25690082889d1e9736a1c8c193a9c60035483cbf71cfada4eb354b03276a8142"} Jul 02 17:40:12.258575 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:12.258572 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z" Jul 02 17:40:12.259033 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:12.258601 2582 scope.go:117] "RemoveContainer" containerID="2d84c08e9b1f9aede5eee2ed5243331af305f387d3926497e8b5d02d0c2319d8" Jul 02 17:40:12.274455 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:12.274432 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z"] Jul 02 17:40:12.278154 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:12.278133 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0e06fb-6d59df4474-q6d2z"] Jul 02 17:40:13.618864 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:13.618830 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="108ae400-3f9b-4804-b83b-d64b0f4e2c25" path="/var/lib/kubelet/pods/108ae400-3f9b-4804-b83b-d64b0f4e2c25/volumes" Jul 02 17:40:18.783108 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:18.783081 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8"] Jul 02 17:40:18.783588 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:18.783404 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" podUID="0388e43a-6b76-4667-bde1-2ea7bb480bf3" containerName="maas-api" containerID="cri-o://9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7" gracePeriod=30 Jul 02 17:40:19.027568 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.027544 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:40:19.062319 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.062244 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0388e43a-6b76-4667-bde1-2ea7bb480bf3-maas-api-tls\") pod \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " Jul 02 17:40:19.062319 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.062303 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpm7g\" (UniqueName: \"kubernetes.io/projected/0388e43a-6b76-4667-bde1-2ea7bb480bf3-kube-api-access-gpm7g\") pod \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " Jul 02 17:40:19.062477 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.062342 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0388e43a-6b76-4667-bde1-2ea7bb480bf3-openshift-service-ca\") pod \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\" (UID: \"0388e43a-6b76-4667-bde1-2ea7bb480bf3\") " Jul 02 17:40:19.062742 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.062722 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0388e43a-6b76-4667-bde1-2ea7bb480bf3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0388e43a-6b76-4667-bde1-2ea7bb480bf3" (UID: "0388e43a-6b76-4667-bde1-2ea7bb480bf3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:40:19.064637 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.064612 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0388e43a-6b76-4667-bde1-2ea7bb480bf3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0388e43a-6b76-4667-bde1-2ea7bb480bf3" (UID: "0388e43a-6b76-4667-bde1-2ea7bb480bf3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:40:19.065561 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.065533 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0388e43a-6b76-4667-bde1-2ea7bb480bf3-kube-api-access-gpm7g" (OuterVolumeSpecName: "kube-api-access-gpm7g") pod "0388e43a-6b76-4667-bde1-2ea7bb480bf3" (UID: "0388e43a-6b76-4667-bde1-2ea7bb480bf3"). InnerVolumeSpecName "kube-api-access-gpm7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:40:19.163200 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.163165 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0388e43a-6b76-4667-bde1-2ea7bb480bf3-maas-api-tls\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:40:19.163200 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.163200 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpm7g\" (UniqueName: \"kubernetes.io/projected/0388e43a-6b76-4667-bde1-2ea7bb480bf3-kube-api-access-gpm7g\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:40:19.163394 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.163216 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0388e43a-6b76-4667-bde1-2ea7bb480bf3-openshift-service-ca\") on node \"ip-10-0-140-177.ec2.internal\" DevicePath \"\"" Jul 02 17:40:19.296143 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.296113 2582 generic.go:356] "Generic (PLEG): container finished" podID="0388e43a-6b76-4667-bde1-2ea7bb480bf3" containerID="9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7" exitCode=0 Jul 02 17:40:19.296336 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.296159 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" event={"ID":"0388e43a-6b76-4667-bde1-2ea7bb480bf3","Type":"ContainerDied","Data":"9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7"} Jul 02 17:40:19.296336 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.296165 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" Jul 02 17:40:19.296336 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.296202 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8" event={"ID":"0388e43a-6b76-4667-bde1-2ea7bb480bf3","Type":"ContainerDied","Data":"d0c51ea65623488a71495c12cc25e78b56ccd5738ffda8362928c2686165ddcc"} Jul 02 17:40:19.296336 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.296226 2582 scope.go:117] "RemoveContainer" containerID="9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7" Jul 02 17:40:19.305887 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.305871 2582 scope.go:117] "RemoveContainer" containerID="9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7" Jul 02 17:40:19.306130 ip-10-0-140-177 kubenswrapper[2582]: E0702 17:40:19.306112 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7\": container with ID starting with 9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7 not found: ID does not exist" containerID="9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7" Jul 02 17:40:19.306193 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.306137 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7"} err="failed to get container status \"9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7\": rpc error: code = NotFound desc = could not find container \"9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7\": container with ID starting with 9d90731f12926e483a6c210dbbf3ce8489c386f83a6fd800339a95a6881b99e7 not found: ID does not exist" Jul 02 17:40:19.318979 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.318925 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8"] Jul 02 17:40:19.323531 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.323513 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d87672-6d45f48b4-sbmz8"] Jul 02 17:40:19.618515 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:19.618484 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0388e43a-6b76-4667-bde1-2ea7bb480bf3" path="/var/lib/kubelet/pods/0388e43a-6b76-4667-bde1-2ea7bb480bf3/volumes" Jul 02 17:40:30.185240 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:30.185210 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-86f58868c9-86ttl_c8918fad-f322-4296-8de5-bc5711a97eb3/maas-api/0.log" Jul 02 17:40:30.532118 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:30.532050 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67458d6c8d-gcwcs_c191ec2e-5a7a-449c-b2c0-cf5d832a020d/manager/0.log" Jul 02 17:40:30.892653 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:30.892628 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7758cbfb47-688zx_db396e0b-a4ce-4d4a-91f4-d34050a4dc5c/copy-manifests/0.log" Jul 02 17:40:30.899892 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:30.899871 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7758cbfb47-688zx_db396e0b-a4ce-4d4a-91f4-d34050a4dc5c/manager/0.log" Jul 02 17:40:31.270829 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:31.270805 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-t4hpd_38b29694-37b6-4d4e-8171-e050404ac4d0/postgres/0.log" Jul 02 17:40:33.187163 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:33.187126 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kkctf_4b6e6e58-7605-4781-a34e-106adeb1b933/manager/0.log" Jul 02 17:40:33.930870 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:33.930832 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4gn4w_d6340867-34af-4d5f-b026-c33335ab3465/discovery/0.log" Jul 02 17:40:34.405752 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:34.405720 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-wtqnt_d8dd3bed-0677-47c5-a094-e5140839b9c0/payload-pre-processing/0.log" Jul 02 17:40:34.524274 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:34.524245 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8cc8t_a35bee41-b388-4cda-b2bf-f1f9c8d28295/payload-processing/0.log" Jul 02 17:40:35.136552 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:35.136511 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-g9kkg_a6363eeb-a79b-4508-94cd-5aa9d3206994/main/0.log" Jul 02 17:40:35.476631 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:35.476541 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-25zmz_13a53eb3-0d2f-4490-9571-633832c19d3f/main/0.log" Jul 02 17:40:42.537389 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:42.537360 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qrjtq_266386cf-6c7a-4cba-8514-14997ab0e3b2/global-pull-secret-syncer/0.log" Jul 02 17:40:42.649577 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:42.649544 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r2xq2_99224f0f-3094-411d-85c2-09d94b6150b2/konnectivity-agent/0.log" Jul 02 17:40:42.762351 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:42.762322 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-177.ec2.internal_17401ed3249bf6dca968e66b7a400752/haproxy/0.log" Jul 02 17:40:48.000035 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:47.999961 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kkctf_4b6e6e58-7605-4781-a34e-106adeb1b933/manager/0.log" Jul 02 17:40:49.570527 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.570501 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a84e154a-54cb-44ba-b73f-ad48da3f081c/alertmanager/0.log" Jul 02 17:40:49.590435 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.590409 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a84e154a-54cb-44ba-b73f-ad48da3f081c/config-reloader/0.log" Jul 02 17:40:49.610238 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.610211 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a84e154a-54cb-44ba-b73f-ad48da3f081c/kube-rbac-proxy-web/0.log" Jul 02 17:40:49.629683 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.629662 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a84e154a-54cb-44ba-b73f-ad48da3f081c/kube-rbac-proxy/0.log" Jul 02 17:40:49.648148 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.648133 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a84e154a-54cb-44ba-b73f-ad48da3f081c/kube-rbac-proxy-metric/0.log" Jul 02 17:40:49.676427 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.676364 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a84e154a-54cb-44ba-b73f-ad48da3f081c/prom-label-proxy/0.log" Jul 02 17:40:49.697980 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.697962 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a84e154a-54cb-44ba-b73f-ad48da3f081c/init-config-reloader/0.log" Jul 02 17:40:49.780626 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.780597 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-nbgqb_5b70113c-87cf-47d6-b361-a52826f553ca/kube-state-metrics/0.log" Jul 02 17:40:49.812720 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.812698 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-nbgqb_5b70113c-87cf-47d6-b361-a52826f553ca/kube-rbac-proxy-main/0.log" Jul 02 17:40:49.836751 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.836727 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-nbgqb_5b70113c-87cf-47d6-b361-a52826f553ca/kube-rbac-proxy-self/0.log" Jul 02 17:40:49.919216 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.919184 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85d8784766-g74gx_ae1a1820-47eb-4771-a024-5fb22ae17437/metrics-server/0.log" Jul 02 17:40:49.948621 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:49.948561 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-8942m_7398f9d5-a1d1-4d49-9af9-ec320c6dbfec/monitoring-plugin/0.log" Jul 02 17:40:50.128972 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.128941 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krdgj_247cf958-5035-4542-9716-2bd3eb23cdf0/node-exporter/0.log" Jul 02 17:40:50.149426 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.149402 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krdgj_247cf958-5035-4542-9716-2bd3eb23cdf0/kube-rbac-proxy/0.log" Jul 02 17:40:50.168838 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.168813 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krdgj_247cf958-5035-4542-9716-2bd3eb23cdf0/init-textfile/0.log" Jul 02 17:40:50.197016 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.196985 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-mdr6j_f6bf9097-bbf0-4b0b-ba32-8553b28f5441/kube-rbac-proxy-main/0.log" Jul 02 17:40:50.216544 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.216470 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-mdr6j_f6bf9097-bbf0-4b0b-ba32-8553b28f5441/kube-rbac-proxy-self/0.log" Jul 02 17:40:50.236447 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.236423 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-mdr6j_f6bf9097-bbf0-4b0b-ba32-8553b28f5441/openshift-state-metrics/0.log" Jul 02 17:40:50.281613 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.281590 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fee584a-7f1d-4c90-a0ae-007c9024441d/prometheus/0.log" Jul 02 17:40:50.302001 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.301979 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fee584a-7f1d-4c90-a0ae-007c9024441d/config-reloader/0.log" Jul 02 17:40:50.323846 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.323822 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fee584a-7f1d-4c90-a0ae-007c9024441d/thanos-sidecar/0.log" Jul 02 17:40:50.345450 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.345422 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fee584a-7f1d-4c90-a0ae-007c9024441d/kube-rbac-proxy-web/0.log" Jul 02 17:40:50.371935 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.371912 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fee584a-7f1d-4c90-a0ae-007c9024441d/kube-rbac-proxy/0.log" Jul 02 17:40:50.397131 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.397113 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fee584a-7f1d-4c90-a0ae-007c9024441d/kube-rbac-proxy-thanos/0.log" Jul 02 17:40:50.417503 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.417484 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fee584a-7f1d-4c90-a0ae-007c9024441d/init-config-reloader/0.log" Jul 02 17:40:50.446653 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.446630 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-4b7kw_e77a72b0-ae3c-4a7f-9614-bc3480217b2a/prometheus-operator/0.log" Jul 02 17:40:50.464987 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.464966 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-4b7kw_e77a72b0-ae3c-4a7f-9614-bc3480217b2a/kube-rbac-proxy/0.log" Jul 02 17:40:50.519016 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.518937 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-646549dcf4-88tvv_1c09c50d-3596-45c7-b7ae-62183bcbf470/telemeter-client/0.log" Jul 02 17:40:50.539648 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.539624 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-646549dcf4-88tvv_1c09c50d-3596-45c7-b7ae-62183bcbf470/reload/0.log" Jul 02 17:40:50.559520 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.559489 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-646549dcf4-88tvv_1c09c50d-3596-45c7-b7ae-62183bcbf470/kube-rbac-proxy/0.log" Jul 02 17:40:50.590500 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.590470 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5574bdf7-xd87s_4c1935c0-0618-48ff-a085-c14ddea5af3f/thanos-query/0.log" Jul 02 17:40:50.615092 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.615056 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5574bdf7-xd87s_4c1935c0-0618-48ff-a085-c14ddea5af3f/kube-rbac-proxy-web/0.log" Jul 02 17:40:50.631016 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.630985 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5574bdf7-xd87s_4c1935c0-0618-48ff-a085-c14ddea5af3f/kube-rbac-proxy/0.log" Jul 02 17:40:50.653238 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.653215 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5574bdf7-xd87s_4c1935c0-0618-48ff-a085-c14ddea5af3f/prom-label-proxy/0.log" Jul 02 17:40:50.672843 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.672822 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5574bdf7-xd87s_4c1935c0-0618-48ff-a085-c14ddea5af3f/kube-rbac-proxy-rules/0.log" Jul 02 17:40:50.691441 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:50.691420 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5574bdf7-xd87s_4c1935c0-0618-48ff-a085-c14ddea5af3f/kube-rbac-proxy-metrics/0.log" Jul 02 17:40:52.419544 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.419458 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn"] Jul 02 17:40:52.420235 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.420213 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0388e43a-6b76-4667-bde1-2ea7bb480bf3" containerName="maas-api" Jul 02 17:40:52.420235 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.420235 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0388e43a-6b76-4667-bde1-2ea7bb480bf3" containerName="maas-api" Jul 02 17:40:52.420394 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.420251 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="108ae400-3f9b-4804-b83b-d64b0f4e2c25" containerName="maas-api" Jul 02 17:40:52.420394 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.420260 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="108ae400-3f9b-4804-b83b-d64b0f4e2c25" containerName="maas-api" Jul 02 17:40:52.420394 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.420362 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="108ae400-3f9b-4804-b83b-d64b0f4e2c25" containerName="maas-api" Jul 02 17:40:52.420394 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.420373 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0388e43a-6b76-4667-bde1-2ea7bb480bf3" containerName="maas-api" Jul 02 17:40:52.423793 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.423775 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.426246 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.426229 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pdk5z\"/\"kube-root-ca.crt\"" Jul 02 17:40:52.426370 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.426354 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pdk5z\"/\"default-dockercfg-lz9qx\"" Jul 02 17:40:52.426433 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.426384 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pdk5z\"/\"openshift-service-ca.crt\"" Jul 02 17:40:52.430152 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.430130 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn"] Jul 02 17:40:52.571516 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.571480 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-lib-modules\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.571701 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.571527 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-podres\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.571701 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.571554 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-sys\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.571701 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.571581 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rp5v\" (UniqueName: \"kubernetes.io/projected/18b7d039-fddd-4290-9312-34cce2b0b033-kube-api-access-5rp5v\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.571701 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.571679 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-proc\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.672236 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.672145 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-podres\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.672236 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.672197 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-sys\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.672236 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.672228 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rp5v\" (UniqueName: \"kubernetes.io/projected/18b7d039-fddd-4290-9312-34cce2b0b033-kube-api-access-5rp5v\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.672478 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.672324 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-sys\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.672478 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.672358 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-podres\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.672478 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.672363 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-proc\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.672478 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.672406 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-proc\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.672478 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.672443 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-lib-modules\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.672650 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.672556 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18b7d039-fddd-4290-9312-34cce2b0b033-lib-modules\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.680229 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.680199 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rp5v\" (UniqueName: \"kubernetes.io/projected/18b7d039-fddd-4290-9312-34cce2b0b033-kube-api-access-5rp5v\") pod \"perf-node-gather-daemonset-fltxn\" (UID: \"18b7d039-fddd-4290-9312-34cce2b0b033\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.735528 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.735495 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:52.870565 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:52.870531 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn"] Jul 02 17:40:52.872027 ip-10-0-140-177 kubenswrapper[2582]: W0702 17:40:52.872000 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod18b7d039_fddd_4290_9312_34cce2b0b033.slice/crio-9989119ce3744922a78ccf15f609c8b9d18dc1ef48ade7dc5d63d08f4ea44fb4 WatchSource:0}: Error finding container 9989119ce3744922a78ccf15f609c8b9d18dc1ef48ade7dc5d63d08f4ea44fb4: Status 404 returned error can't find the container with id 9989119ce3744922a78ccf15f609c8b9d18dc1ef48ade7dc5d63d08f4ea44fb4 Jul 02 17:40:53.094323 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:53.094271 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fdcfbf94f-5rzlk_21680c9c-e627-404a-adde-91b312333273/console/0.log" Jul 02 17:40:53.463155 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:53.463118 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" event={"ID":"18b7d039-fddd-4290-9312-34cce2b0b033","Type":"ContainerStarted","Data":"bf8347db78bfa81590613cb34109333fb9a0252238579bef189834172ec8db06"} Jul 02 17:40:53.463578 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:53.463173 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" event={"ID":"18b7d039-fddd-4290-9312-34cce2b0b033","Type":"ContainerStarted","Data":"9989119ce3744922a78ccf15f609c8b9d18dc1ef48ade7dc5d63d08f4ea44fb4"} Jul 02 17:40:53.463578 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:53.463310 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:40:53.480684 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:53.480629 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" podStartSLOduration=1.480614457 podStartE2EDuration="1.480614457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:40:53.477655398 +0000 UTC m=+2604.031497818" watchObservedRunningTime="2026-07-02 17:40:53.480614457 +0000 UTC m=+2604.034457019" Jul 02 17:40:54.660417 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:54.660379 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fb79t_f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6/dns/0.log" Jul 02 17:40:54.684622 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:54.684601 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fb79t_f7319a14-9f15-4ff3-a88a-a4ea1d2d87b6/kube-rbac-proxy/0.log" Jul 02 17:40:54.817878 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:54.817849 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bvvxz_ae654452-b41a-4ef8-9c54-b29a75d6d251/dns-node-resolver/0.log" Jul 02 17:40:55.422698 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:55.422673 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pdg2b_b317bb03-701a-42dc-94c2-91b9150c56b2/node-ca/0.log" Jul 02 17:40:56.524412 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:56.524376 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4gn4w_d6340867-34af-4d5f-b026-c33335ab3465/discovery/0.log" Jul 02 17:40:56.684691 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:56.684657 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-wtqnt_d8dd3bed-0677-47c5-a094-e5140839b9c0/payload-pre-processing/0.log" Jul 02 17:40:56.757492 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:56.757457 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8cc8t_a35bee41-b388-4cda-b2bf-f1f9c8d28295/payload-processing/0.log" Jul 02 17:40:57.455565 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:57.455535 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k4x6s_964e9e04-1c1d-45ad-9e51-a44a556c015c/serve-healthcheck-canary/0.log" Jul 02 17:40:58.022089 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:58.022059 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbpsw_6f432707-7bc0-4595-820c-5704a313ee71/kube-rbac-proxy/0.log" Jul 02 17:40:58.041908 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:58.041886 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbpsw_6f432707-7bc0-4595-820c-5704a313ee71/exporter/0.log" Jul 02 17:40:58.061728 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:58.061704 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbpsw_6f432707-7bc0-4595-820c-5704a313ee71/extractor/0.log" Jul 02 17:40:59.480427 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:40:59.480400 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-fltxn" Jul 02 17:41:00.450240 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:00.450212 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-86f58868c9-86ttl_c8918fad-f322-4296-8de5-bc5711a97eb3/maas-api/0.log" Jul 02 17:41:00.652206 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:00.652171 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67458d6c8d-gcwcs_c191ec2e-5a7a-449c-b2c0-cf5d832a020d/manager/0.log" Jul 02 17:41:00.798246 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:00.798162 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7758cbfb47-688zx_db396e0b-a4ce-4d4a-91f4-d34050a4dc5c/manager/0.log" Jul 02 17:41:00.819084 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:00.819062 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7758cbfb47-688zx_db396e0b-a4ce-4d4a-91f4-d34050a4dc5c/copy-manifests/0.log" Jul 02 17:41:01.005046 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:01.005014 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-t4hpd_38b29694-37b6-4d4e-8171-e050404ac4d0/postgres/0.log" Jul 02 17:41:02.680727 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:02.680699 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79ccbb9b6f-wn6xc_df0dacc7-c491-4d49-ab7b-2ba5ae095f23/manager/0.log" Jul 02 17:41:03.036581 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:03.036551 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4gn4w_d6340867-34af-4d5f-b026-c33335ab3465/discovery/0.log" Jul 02 17:41:03.161115 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:03.161087 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-wtqnt_d8dd3bed-0677-47c5-a094-e5140839b9c0/payload-pre-processing/0.log" Jul 02 17:41:03.225449 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:03.225421 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8cc8t_a35bee41-b388-4cda-b2bf-f1f9c8d28295/payload-processing/0.log" Jul 02 17:41:04.591660 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:04.591605 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4gn4w_d6340867-34af-4d5f-b026-c33335ab3465/discovery/0.log" Jul 02 17:41:04.714582 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:04.714552 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-wtqnt_d8dd3bed-0677-47c5-a094-e5140839b9c0/payload-pre-processing/0.log" Jul 02 17:41:04.783015 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:04.782987 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8cc8t_a35bee41-b388-4cda-b2bf-f1f9c8d28295/payload-processing/0.log" Jul 02 17:41:09.219713 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:09.219681 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w829v_330e39e4-88da-45b3-a74a-e7257717a1cc/kube-multus-additional-cni-plugins/0.log" Jul 02 17:41:09.257710 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:09.257682 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w829v_330e39e4-88da-45b3-a74a-e7257717a1cc/egress-router-binary-copy/0.log" Jul 02 17:41:09.294562 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:09.294531 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w829v_330e39e4-88da-45b3-a74a-e7257717a1cc/cni-plugins/0.log" Jul 02 17:41:09.330446 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:09.330417 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w829v_330e39e4-88da-45b3-a74a-e7257717a1cc/bond-cni-plugin/0.log" Jul 02 17:41:09.364080 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:09.364053 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w829v_330e39e4-88da-45b3-a74a-e7257717a1cc/routeoverride-cni/0.log" Jul 02 17:41:09.399533 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:09.399506 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w829v_330e39e4-88da-45b3-a74a-e7257717a1cc/whereabouts-cni-bincopy/0.log" Jul 02 17:41:09.437628 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:09.437600 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w829v_330e39e4-88da-45b3-a74a-e7257717a1cc/whereabouts-cni/0.log" Jul 02 17:41:09.536393 ip-10-0-140-177 kubenswrapper[2582]: I0702 17:41:09.536297 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q8rf6_44482e98-a4ab-4a66-a839-b3ef7709754e/kube-multus/0.log"