Jul 29 10:26:56.386159 ip-10-0-138-43 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 10:26:56.386175 ip-10-0-138-43 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 10:26:56.386184 ip-10-0-138-43 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 10:26:56.386509 ip-10-0-138-43 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 10:27:06.485791 ip-10-0-138-43 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 10:27:06.485811 ip-10-0-138-43 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a0827e12d3204b78a941fc45893495e3 -- Jul 29 10:28:58.588217 ip-10-0-138-43 systemd[1]: Starting Kubernetes Kubelet... Jul 29 10:28:58.965856 ip-10-0-138-43 kubenswrapper[2517]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:28:58.965856 ip-10-0-138-43 kubenswrapper[2517]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 10:28:58.965856 ip-10-0-138-43 kubenswrapper[2517]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:28:58.965856 ip-10-0-138-43 kubenswrapper[2517]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 10:28:58.965856 ip-10-0-138-43 kubenswrapper[2517]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:28:58.967424 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.967348 2517 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 10:28:58.971767 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971752 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:58.971767 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971767 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971771 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971775 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971778 2517 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971781 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971784 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971787 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971790 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971793 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971795 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971798 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971801 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971803 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971806 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971808 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971811 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971822 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971825 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971828 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971832 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:58.971833 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971836 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971840 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971843 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971846 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971849 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971852 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971855 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971858 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971860 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971863 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971866 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971868 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971871 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971874 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971876 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971879 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971882 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971890 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971893 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971895 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:58.972361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971898 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971900 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971903 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971905 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971908 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971910 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971919 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971922 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971924 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971926 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971929 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971932 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971934 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971936 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971940 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971942 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971945 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971947 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971950 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971952 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:58.972848 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971955 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971968 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971970 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971973 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971975 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971978 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971982 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971986 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971990 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.971994 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972000 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972004 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972007 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972009 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972012 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972014 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972017 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972020 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972023 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:58.973383 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972027 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972031 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972034 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972037 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972040 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972045 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972048 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972052 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972055 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972058 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972060 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972063 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972066 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972069 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972071 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972074 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972076 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972079 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972082 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972792 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:58.973858 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972799 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972801 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972804 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972807 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972813 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972816 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972819 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972822 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972825 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972827 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972831 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972835 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972839 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972842 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972845 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972848 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972852 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972854 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972857 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:58.974350 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972860 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972863 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972866 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972868 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972871 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972874 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972876 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972878 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972881 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972883 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972886 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972888 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972891 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972893 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972895 2517 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972898 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972900 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972903 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972909 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972911 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:58.974824 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972914 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972916 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972919 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972923 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972926 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972929 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972932 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972934 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972937 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972940 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972942 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972944 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972947 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972949 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972952 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972954 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972972 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972975 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972977 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972980 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:58.975319 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972983 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972985 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972988 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972990 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972993 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972995 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.972998 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973000 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973003 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973006 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973010 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973013 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973016 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973019 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973021 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973024 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973027 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973031 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973034 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:58.975803 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973038 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973041 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973044 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973047 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973049 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973051 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973054 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973056 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973059 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973061 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973063 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973066 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973068 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973071 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973073 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973076 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973078 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973081 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973083 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973086 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:58.976287 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973426 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973430 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973433 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973436 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973439 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973442 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973444 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973447 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973449 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973452 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973455 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973457 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973460 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973462 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973465 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973467 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973470 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973472 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973475 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973477 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:58.976787 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973480 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973483 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973485 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973488 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973490 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973493 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973495 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973498 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973500 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973502 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973505 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973508 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973511 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973513 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973515 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973518 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973521 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973524 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973526 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973529 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:58.977284 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973534 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973536 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973539 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973542 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973544 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973547 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973549 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973552 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973554 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973557 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973559 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973562 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973564 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973567 2517 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973570 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973572 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973575 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973577 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973580 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973582 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:58.977793 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973584 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973587 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973589 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973594 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973618 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973622 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973625 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973628 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973631 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973634 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973637 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973640 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973643 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973646 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973648 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973651 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973654 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973656 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973660 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:58.978334 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973664 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973667 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973671 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973674 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973678 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973682 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973686 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973689 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973691 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973694 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973697 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973699 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973702 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973704 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973707 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973709 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973715 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973718 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973720 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.973723 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:58.978846 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973785 2517 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973791 2517 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973798 2517 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973802 2517 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973809 2517 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973814 2517 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973818 2517 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973822 2517 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973826 2517 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973829 2517 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973833 2517 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973836 2517 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973839 2517 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973842 2517 flags.go:64] FLAG: --cgroup-root="" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973845 2517 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973848 2517 flags.go:64] FLAG: --client-ca-file="" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973850 2517 flags.go:64] FLAG: --cloud-provider="external" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973853 2517 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973857 2517 flags.go:64] FLAG: --cluster-domain="" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973860 2517 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973864 2517 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973867 2517 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973870 2517 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973874 2517 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 10:28:58.979363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973877 2517 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973880 2517 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973884 2517 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973887 2517 flags.go:64] FLAG: --contention-profiling="false" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973890 2517 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973893 2517 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973896 2517 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973899 2517 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973908 2517 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973911 2517 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973913 2517 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973916 2517 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973919 2517 flags.go:64] FLAG: --enable-server="true" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973924 2517 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973928 2517 flags.go:64] FLAG: --event-burst="100" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973931 2517 flags.go:64] FLAG: --event-qps="50" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973934 2517 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973937 2517 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973939 2517 flags.go:64] FLAG: --eviction-hard="" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973943 2517 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973946 2517 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973949 2517 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973952 2517 flags.go:64] FLAG: --eviction-soft="" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973955 2517 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973970 2517 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 10:28:58.979985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973976 2517 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973980 2517 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973985 2517 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973989 2517 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973992 2517 flags.go:64] FLAG: --feature-gates="" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973996 2517 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.973999 2517 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974002 2517 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974005 2517 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974008 2517 flags.go:64] FLAG: --healthz-port="10248" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974010 2517 flags.go:64] FLAG: --help="false" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974014 2517 flags.go:64] FLAG: --hostname-override="ip-10-0-138-43.ec2.internal" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974017 2517 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974020 2517 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974023 2517 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974027 2517 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974030 2517 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974032 2517 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974035 2517 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974038 2517 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974043 2517 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974046 2517 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974049 2517 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974052 2517 flags.go:64] FLAG: --kube-reserved="" Jul 29 10:28:58.980649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974055 2517 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974058 2517 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974061 2517 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974063 2517 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974066 2517 flags.go:64] FLAG: --lock-file="" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974069 2517 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974072 2517 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974075 2517 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974080 2517 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974083 2517 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974085 2517 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974088 2517 flags.go:64] FLAG: --logging-format="text" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974091 2517 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974094 2517 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974097 2517 flags.go:64] FLAG: --manifest-url="" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974100 2517 flags.go:64] FLAG: --manifest-url-header="" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974104 2517 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974107 2517 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974111 2517 flags.go:64] FLAG: --max-pods="110" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974114 2517 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974117 2517 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974120 2517 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974123 2517 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974126 2517 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974129 2517 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 10:28:58.981259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974132 2517 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974139 2517 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974142 2517 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974146 2517 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974149 2517 flags.go:64] FLAG: --pod-cidr="" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974152 2517 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974157 2517 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974160 2517 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974163 2517 flags.go:64] FLAG: --pods-per-core="0" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974166 2517 flags.go:64] FLAG: --port="10250" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974169 2517 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974172 2517 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f0a5bc38e416bb24" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974175 2517 flags.go:64] FLAG: --qos-reserved="" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974179 2517 flags.go:64] FLAG: --read-only-port="10255" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974182 2517 flags.go:64] FLAG: --register-node="true" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974184 2517 flags.go:64] FLAG: --register-with-taints="" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974188 2517 flags.go:64] FLAG: --registry-burst="10" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974191 2517 flags.go:64] FLAG: --registry-qps="5" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974193 2517 flags.go:64] FLAG: --reserved-cpus="" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974196 2517 flags.go:64] FLAG: --reserved-memory="" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974200 2517 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974203 2517 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974205 2517 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974208 2517 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974211 2517 flags.go:64] FLAG: --runonce="false" Jul 29 10:28:58.981874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974214 2517 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974217 2517 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974220 2517 flags.go:64] FLAG: --seccomp-default="false" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974223 2517 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974225 2517 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974228 2517 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974231 2517 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974234 2517 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974237 2517 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974240 2517 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974244 2517 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974247 2517 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974250 2517 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974253 2517 flags.go:64] FLAG: --system-cgroups="" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974256 2517 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974261 2517 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974264 2517 flags.go:64] FLAG: --tls-cert-file="" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974266 2517 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974270 2517 flags.go:64] FLAG: --tls-min-version="" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974273 2517 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974275 2517 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974278 2517 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974281 2517 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974284 2517 flags.go:64] FLAG: --v="2" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974288 2517 flags.go:64] FLAG: --version="false" Jul 29 10:28:58.982498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974291 2517 flags.go:64] FLAG: --vmodule="" Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974295 2517 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.974298 2517 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974403 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974407 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974410 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974412 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974415 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974418 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974422 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974424 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974427 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974430 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974432 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974435 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974438 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974440 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974444 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974447 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974450 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:58.983131 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974452 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974455 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974458 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974461 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974463 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974466 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974469 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974473 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974476 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974480 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974483 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974486 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974488 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974491 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974494 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974497 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974500 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974503 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974506 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:58.983620 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974508 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974511 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974515 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974517 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974520 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974523 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974525 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974528 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974530 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974534 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974538 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974541 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974544 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974547 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974549 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974553 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974556 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974558 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974561 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:58.984148 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974563 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974566 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974569 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974571 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974574 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974576 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974579 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974582 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974585 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974589 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974592 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974595 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974598 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974601 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974604 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974608 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974611 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974613 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974616 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974619 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:58.984634 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974621 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974624 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974626 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974630 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974633 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974636 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974638 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974641 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974644 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974646 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974649 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974651 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974654 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974657 2517 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974659 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974661 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974664 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974666 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974669 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974672 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:58.985144 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974675 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974677 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974680 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.974682 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.975290 2517 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.981844 2517 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.981863 2517 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.982632 2517 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.982642 2517 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982714 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982722 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982727 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982731 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982736 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982740 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:58.985703 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982744 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982748 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982753 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982757 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982761 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982765 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982770 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982774 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982778 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982782 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982786 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982789 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982792 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982796 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982800 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982804 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982807 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982811 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982814 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982818 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:58.986087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982822 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982826 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982829 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982834 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982838 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982842 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982846 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982850 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982854 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982858 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982862 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982865 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982869 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982873 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982877 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982880 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982883 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982887 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982890 2517 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982895 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:58.986608 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982898 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982902 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982905 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982908 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982912 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982915 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982921 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982926 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982930 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982934 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982937 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982941 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982945 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982949 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982952 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982969 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982974 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982978 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982982 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:58.987112 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982985 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982989 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982992 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.982996 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983000 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983003 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983007 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983011 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983014 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983018 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983022 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983026 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983029 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983034 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983038 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983041 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983045 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983049 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983052 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983056 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:58.987562 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983059 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983062 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983066 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983072 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983077 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983081 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983085 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983091 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983096 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983101 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983105 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983110 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983114 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983118 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:58.988087 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.983124 2517 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983278 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983284 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983289 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983293 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983297 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983301 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983305 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983311 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983316 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983320 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983324 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983328 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983332 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983335 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983339 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983342 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983345 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983349 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:58.988461 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983353 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983356 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983360 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983363 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983367 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983370 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983374 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983378 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983383 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983387 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983390 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983394 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983399 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983403 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983408 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983412 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983415 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983419 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983422 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:58.988925 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983426 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983430 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983434 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983437 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983441 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983444 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983448 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983452 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983456 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983460 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983463 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983468 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983471 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983475 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983479 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983484 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983488 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983492 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983496 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:58.989468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983501 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983505 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983509 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983514 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983518 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983522 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983526 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983529 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983533 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983537 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983540 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983544 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983548 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983551 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983555 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983558 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983562 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983566 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983569 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983573 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:58.989926 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983577 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983581 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983584 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983588 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983592 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983596 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983599 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983603 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983606 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983610 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983613 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983616 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983620 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983624 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983628 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983631 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983635 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983638 2517 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983642 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983646 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:58.990454 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983650 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:58.990974 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983654 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:58.990974 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:28:58.983657 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:58.990974 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.983664 2517 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:28:58.990974 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.983783 2517 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 10:28:58.990974 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.986362 2517 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 10:28:58.990974 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.987688 2517 server.go:1019] "Starting client certificate rotation" Jul 29 10:28:58.990974 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.987784 2517 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 10:28:58.990974 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.988431 2517 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 10:28:58.990974 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.990633 2517 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 10:28:58.996337 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:58.996315 2517 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 10:28:59.003583 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.003565 2517 log.go:25] "Validated CRI v1 runtime API" Jul 29 10:28:59.005443 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.005428 2517 log.go:25] "Validated CRI v1 image API" Jul 29 10:28:59.007312 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.007298 2517 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 10:28:59.010208 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.010186 2517 fs.go:135] Filesystem UUIDs: map[1cbef004-b515-45ff-ae00-bc98ea8a9560:/dev/nvme0n1p4 639db15b-69b8-450e-9b90-5a8d92a7235f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 29 10:28:59.010270 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.010208 2517 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 10:28:59.016668 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.016530 2517 manager.go:216] Machine: {Timestamp:2026-07-29 10:28:59.014875709 +0000 UTC m=+0.315513230 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100055 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25f60bce4cd8568032ed2028e8c523 SystemUUID:ec25f60b-ce4c-d856-8032-ed2028e8c523 BootID:a0827e12-d320-4b78-a941-fc45893495e3 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:24:2b:53:d1:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:24:2b:53:d1:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:dc:27:19:ea:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 10:28:59.016770 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.016669 2517 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 10:28:59.016770 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.016758 2517 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 10:28:59.018156 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.018141 2517 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 10:28:59.019769 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.019740 2517 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 10:28:59.019936 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.019776 2517 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-43.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 10:28:59.020506 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.020494 2517 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 10:28:59.020542 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.020511 2517 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 10:28:59.020542 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.020520 2517 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 10:28:59.020542 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.020537 2517 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 10:28:59.021302 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.021292 2517 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 10:28:59.023025 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.023014 2517 state_mem.go:36] "Initialized new in-memory state store" Jul 29 10:28:59.023163 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.023153 2517 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 10:28:59.023202 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.023193 2517 kubelet.go:486] "Attempting to sync node with API server" Jul 29 10:28:59.023235 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.023214 2517 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 10:28:59.023263 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.023238 2517 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 10:28:59.023263 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.023252 2517 kubelet.go:398] "Adding apiserver pod source" Jul 29 10:28:59.023323 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.023271 2517 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 10:28:59.023694 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.023682 2517 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 10:28:59.023742 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.023705 2517 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 10:28:59.026569 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.026551 2517 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 10:28:59.029936 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.029917 2517 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 10:28:59.030048 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.029984 2517 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 10:28:59.031388 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031374 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 10:28:59.031468 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031395 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 10:28:59.031468 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031405 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 10:28:59.031468 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031415 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 10:28:59.031468 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031428 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 10:28:59.031468 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031436 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 10:28:59.031468 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031448 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 10:28:59.031468 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031457 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 10:28:59.031468 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031467 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 10:28:59.031707 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031475 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 10:28:59.031707 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031488 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 10:28:59.031707 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.031496 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 10:28:59.032315 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.032303 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 10:28:59.032363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.032317 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 10:28:59.033118 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.033091 2517 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-43.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 10:28:59.033118 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.033091 2517 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 10:28:59.035268 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.035253 2517 server.go:1268] "Started kubelet" Jul 29 10:28:59.035387 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.035339 2517 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 10:28:59.035510 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.035456 2517 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 10:28:59.035605 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.035525 2517 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 10:28:59.035976 ip-10-0-138-43 systemd[1]: Started Kubernetes Kubelet. Jul 29 10:28:59.037150 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.037135 2517 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 10:28:59.037364 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.037352 2517 server.go:310] "Adding debug handlers to kubelet server" Jul 29 10:28:59.042139 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.042115 2517 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 10:28:59.043435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.043413 2517 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 10:28:59.043519 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.043415 2517 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 10:28:59.043844 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.043574 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:28:59.044018 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044003 2517 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 10:28:59.044182 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044163 2517 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-43.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 10:28:59.044182 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044176 2517 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 10:28:59.044285 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044193 2517 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 10:28:59.044285 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044274 2517 reconstruct.go:97] "Volume reconstruction finished" Jul 29 10:28:59.044285 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044284 2517 reconciler.go:29] "Reconciler: start to sync state" Jul 29 10:28:59.044693 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044667 2517 factory.go:153] Registering CRI-O factory Jul 29 10:28:59.044693 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044685 2517 factory.go:223] Registration of the crio container factory successfully Jul 29 10:28:59.044822 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044729 2517 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 10:28:59.044822 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044739 2517 factory.go:55] Registering systemd factory Jul 29 10:28:59.044822 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044747 2517 factory.go:223] Registration of the systemd container factory successfully Jul 29 10:28:59.044822 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044768 2517 factory.go:103] Registering Raw factory Jul 29 10:28:59.044822 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.044781 2517 manager.go:1196] Started watching for new ooms in manager Jul 29 10:28:59.045135 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.045115 2517 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wvhr7" Jul 29 10:28:59.045281 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.045267 2517 manager.go:349] Starting recovery of all containers Jul 29 10:28:59.047044 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.044072 2517 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-43.ec2.internal.18c6bbef5d42f66c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-43.ec2.internal,UID:ip-10-0-138-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-43.ec2.internal,},FirstTimestamp:2026-07-29 10:28:59.035227756 +0000 UTC m=+0.335865275,LastTimestamp:2026-07-29 10:28:59.035227756 +0000 UTC m=+0.335865275,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-43.ec2.internal,}" Jul 29 10:28:59.056018 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.055979 2517 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wvhr7" Jul 29 10:28:59.057332 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.057292 2517 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 10:28:59.057424 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.057395 2517 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-43.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 10:28:59.062571 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.062553 2517 manager.go:354] Recovery completed Jul 29 10:28:59.066470 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.066457 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:59.068341 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.068324 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:59.068423 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.068357 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:59.068423 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.068370 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:59.068985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.068954 2517 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 10:28:59.068985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.068983 2517 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 10:28:59.069112 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.068999 2517 state_mem.go:36] "Initialized new in-memory state store" Jul 29 10:28:59.069112 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.069043 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:59.069793 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.069775 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:59.069872 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.069801 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:59.069872 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.069811 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:59.070139 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.070076 2517 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-43.ec2.internal.18c6bbef5f3c3816 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-43.ec2.internal,UID:ip-10-0-138-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-43.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-43.ec2.internal,},FirstTimestamp:2026-07-29 10:28:59.068340246 +0000 UTC m=+0.368977767,LastTimestamp:2026-07-29 10:28:59.068340246 +0000 UTC m=+0.368977767,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-43.ec2.internal,}" Jul 29 10:28:59.073579 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.073562 2517 policy_none.go:49] "None policy: Start" Jul 29 10:28:59.073643 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.073583 2517 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 10:28:59.073643 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.073597 2517 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 10:28:59.076084 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.076069 2517 policy_none.go:47] "Start" Jul 29 10:28:59.115609 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.115496 2517 manager.go:337] "Starting Device Plugin manager" Jul 29 10:28:59.115701 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.115618 2517 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 10:28:59.115701 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.115632 2517 server.go:87] "Starting device plugin registration server" Jul 29 10:28:59.115818 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.115807 2517 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 10:28:59.115900 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.115828 2517 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 10:28:59.115951 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.115924 2517 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 10:28:59.116043 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.116031 2517 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 10:28:59.116094 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.116045 2517 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 10:28:59.116571 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.116496 2517 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 10:28:59.116571 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.116551 2517 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:28:59.211139 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.211115 2517 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 10:28:59.212314 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.212298 2517 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 10:28:59.212386 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.212333 2517 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 10:28:59.212386 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.212355 2517 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 10:28:59.212474 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.212384 2517 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 10:28:59.215350 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.215335 2517 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:28:59.216925 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.216894 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:59.217637 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.217623 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:59.217705 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.217653 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:59.217705 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.217666 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:59.217705 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.217687 2517 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.226261 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.226243 2517 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.226351 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.226264 2517 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-43.ec2.internal\": node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:28:59.245325 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.245308 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:28:59.312608 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.312588 2517 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-43.ec2.internal"] Jul 29 10:28:59.312677 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.312655 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:59.316393 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.316366 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:59.316459 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.316401 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:59.316459 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.316411 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:59.317610 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.317596 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:59.317733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.317719 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.317790 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.317753 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:59.318361 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.318340 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:59.318440 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.318370 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:59.318440 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.318385 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:59.318440 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.318432 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:59.318532 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.318449 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:59.318532 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.318462 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:59.319683 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.319670 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.319743 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.319692 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:59.320406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.320393 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:59.320482 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.320418 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:59.320482 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.320431 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:59.345573 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.345544 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:28:59.345669 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.345612 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2dd5713812e824284c4e3f717a7001f2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-43.ec2.internal\" (UID: \"2dd5713812e824284c4e3f717a7001f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.345669 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.345634 2517 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-43.ec2.internal\" not found" node="ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.345669 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.345654 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52d45821e2c58c5f03e9cafc844c27d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal\" (UID: \"52d45821e2c58c5f03e9cafc844c27d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.345785 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.345687 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52d45821e2c58c5f03e9cafc844c27d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal\" (UID: \"52d45821e2c58c5f03e9cafc844c27d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.349938 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.349920 2517 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-43.ec2.internal\" not found" node="ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.446075 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.446055 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:28:59.446142 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.446098 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52d45821e2c58c5f03e9cafc844c27d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal\" (UID: \"52d45821e2c58c5f03e9cafc844c27d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.446142 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.446124 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52d45821e2c58c5f03e9cafc844c27d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal\" (UID: \"52d45821e2c58c5f03e9cafc844c27d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.446243 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.446159 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2dd5713812e824284c4e3f717a7001f2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-43.ec2.internal\" (UID: \"2dd5713812e824284c4e3f717a7001f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.446243 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.446204 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52d45821e2c58c5f03e9cafc844c27d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal\" (UID: \"52d45821e2c58c5f03e9cafc844c27d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.446243 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.446215 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2dd5713812e824284c4e3f717a7001f2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-43.ec2.internal\" (UID: \"2dd5713812e824284c4e3f717a7001f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.446243 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:28:59.446202 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52d45821e2c58c5f03e9cafc844c27d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal\" (UID: \"52d45821e2c58c5f03e9cafc844c27d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" Jul 29 10:28:59.546760 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:28:59.546710 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:29:01.197876 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:01.197855 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:29:01.198950 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:01.198935 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" Jul 29 10:29:01.204753 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:01.204738 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-43.ec2.internal" Jul 29 10:29:01.298113 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:01.298086 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:29:01.398489 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:01.398438 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:29:01.498851 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:01.498824 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:29:01.538029 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:01.537989 2517 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 10:29:01.538395 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:01.538133 2517 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 10:29:01.599623 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:01.599602 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:29:01.612625 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:01.612598 2517 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 10:24:00 +0000 UTC" deadline="2028-03-12 20:59:05.72477079 +0000 UTC" Jul 29 10:29:01.612625 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:01.612621 2517 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14218h30m4.112152239s" Jul 29 10:29:01.700555 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:01.700513 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:29:01.746672 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:29:01.746642 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd5713812e824284c4e3f717a7001f2.slice/crio-8d9c7716a54ced52a14fbded157b41c0f99e0ab45cb282f6305b8e2d6bea3101 WatchSource:0}: Error finding container 8d9c7716a54ced52a14fbded157b41c0f99e0ab45cb282f6305b8e2d6bea3101: Status 404 returned error can't find the container with id 8d9c7716a54ced52a14fbded157b41c0f99e0ab45cb282f6305b8e2d6bea3101 Jul 29 10:29:01.752481 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:01.752464 2517 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 10:29:01.766295 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:01.766255 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-43.ec2.internal" event={"ID":"2dd5713812e824284c4e3f717a7001f2","Type":"ContainerStarted","Data":"8d9c7716a54ced52a14fbded157b41c0f99e0ab45cb282f6305b8e2d6bea3101"} Jul 29 10:29:01.801551 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:01.801529 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:29:01.880492 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:01.880465 2517 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:29:01.901975 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:01.901949 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:29:02.002151 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.002084 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-43.ec2.internal\" not found" Jul 29 10:29:02.002435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.002421 2517 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:29:02.068909 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.068884 2517 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:29:02.095463 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.095444 2517 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" Jul 29 10:29:02.105489 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.105468 2517 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 10:29:02.106481 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.106464 2517 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-43.ec2.internal" Jul 29 10:29:02.113962 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.113942 2517 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 10:29:02.181453 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:29:02.181432 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d45821e2c58c5f03e9cafc844c27d5.slice/crio-6329283b7ff5f3347a7d888682b52557f3a72b6e1b984c11aab0d242c447f91d WatchSource:0}: Error finding container 6329283b7ff5f3347a7d888682b52557f3a72b6e1b984c11aab0d242c447f91d: Status 404 returned error can't find the container with id 6329283b7ff5f3347a7d888682b52557f3a72b6e1b984c11aab0d242c447f91d Jul 29 10:29:02.574465 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.574431 2517 apiserver.go:52] "Watching apiserver" Jul 29 10:29:02.578614 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.578590 2517 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 10:29:02.579984 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.579956 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-6lkk9","openshift-ovn-kubernetes/ovnkube-node-t7g4l","kube-system/konnectivity-agent-gxscm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m","openshift-cluster-node-tuning-operator/tuned-qv2zf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal","openshift-multus/multus-additional-cni-plugins-k6gbl","openshift-network-diagnostics/network-check-target-mrgw4","kube-system/global-pull-secret-syncer-72csv","kube-system/kube-apiserver-proxy-ip-10-0-138-43.ec2.internal","openshift-dns/node-resolver-7rkjp","openshift-image-registry/node-ca-shzv5","openshift-multus/multus-s2wcl","openshift-multus/network-metrics-daemon-hpzsh"] Jul 29 10:29:02.581792 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.581770 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.583267 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.583248 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.583564 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.583537 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 10:29:02.583710 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.583676 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 10:29:02.583847 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.583832 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jknfd\"" Jul 29 10:29:02.583913 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.583853 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 10:29:02.583913 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.583907 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 10:29:02.584122 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.584106 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 10:29:02.584261 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.584234 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:02.585030 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.585007 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 10:29:02.585152 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.585126 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-psxx7\"" Jul 29 10:29:02.585926 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.585911 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 10:29:02.586088 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.586075 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 10:29:02.586376 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.586250 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dpbsw\"" Jul 29 10:29:02.586376 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.586318 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.587424 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.587390 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.588620 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.588588 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 10:29:02.591178 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.589176 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 10:29:02.591178 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.590008 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 10:29:02.591178 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.590113 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 10:29:02.591178 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.590349 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-db55q\"" Jul 29 10:29:02.591178 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.590390 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 10:29:02.591178 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.590859 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7996h\"" Jul 29 10:29:02.591429 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.591310 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:02.591429 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.591385 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:02.592949 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.592928 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:02.593032 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.593015 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:02.594874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.594617 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6lkk9" Jul 29 10:29:02.594874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.594745 2517 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 10:29:02.596305 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.596280 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.596897 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.596877 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 10:29:02.596897 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.596889 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lhg9x\"" Jul 29 10:29:02.597037 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.596882 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 10:29:02.597151 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.597133 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 10:29:02.598013 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.597993 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 10:29:02.598450 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.598430 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 10:29:02.598450 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.598449 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 10:29:02.598588 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.598516 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 10:29:02.598588 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.598543 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 10:29:02.598588 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.598560 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9mv6h\"" Jul 29 10:29:02.598946 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.598851 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:02.598946 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.598915 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:02.599436 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.599399 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 10:29:02.600478 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.600127 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7rkjp" Jul 29 10:29:02.601393 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.601375 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-shzv5" Jul 29 10:29:02.601982 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.601933 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 10:29:02.602072 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.602030 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 10:29:02.602072 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.602063 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lfc24\"" Jul 29 10:29:02.603154 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.603112 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 10:29:02.603449 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.603432 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 10:29:02.603759 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.603667 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 10:29:02.603885 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.603867 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vmcxw\"" Jul 29 10:29:02.604428 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.604405 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-system-cni-dir\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.604512 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.604443 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-multus-conf-dir\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.604512 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.604468 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-etc-kubernetes\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.604512 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.604495 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn4w4\" (UniqueName: \"kubernetes.io/projected/79bb5c4a-327b-4369-8efb-2cd798838aae-kube-api-access-qn4w4\") pod \"iptables-alerter-6lkk9\" (UID: \"79bb5c4a-327b-4369-8efb-2cd798838aae\") " pod="openshift-network-operator/iptables-alerter-6lkk9" Jul 29 10:29:02.604669 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.604550 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-run-ovn\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.604799 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.604756 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.604908 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.604848 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.604974 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.604891 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-etc-openvswitch\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.604974 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.604943 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.604974 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.604968 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-run-k8s-cni-cncf-io\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.605120 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.604986 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-var-lib-cni-bin\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.605120 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605007 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-sysconfig\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.605120 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605022 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.605120 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605047 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7c33fe7-5b31-459b-bede-8164c9bec386-ovn-node-metrics-cert\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.605120 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605103 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z792\" (UniqueName: \"kubernetes.io/projected/3b2b8b47-f121-4b15-8595-7152e2d10091-kube-api-access-8z792\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:02.605350 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605123 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-system-cni-dir\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.605350 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605139 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2813a209-455f-4de6-9786-a7977764c26b-cni-binary-copy\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.605350 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605167 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0983da81-073a-4164-baf4-f710b75e71a7-agent-certs\") pod \"konnectivity-agent-gxscm\" (UID: \"0983da81-073a-4164-baf4-f710b75e71a7\") " pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:02.605350 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605201 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0983da81-073a-4164-baf4-f710b75e71a7-konnectivity-ca\") pod \"konnectivity-agent-gxscm\" (UID: \"0983da81-073a-4164-baf4-f710b75e71a7\") " pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:02.605350 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605226 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djd96\" (UniqueName: \"kubernetes.io/projected/728d6962-e152-46c0-aa2d-a447848c9bcd-kube-api-access-djd96\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.605350 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605266 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-modprobe-d\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.605350 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605306 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-sys\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.605350 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605333 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-tmp\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605370 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79bb5c4a-327b-4369-8efb-2cd798838aae-iptables-alerter-script\") pod \"iptables-alerter-6lkk9\" (UID: \"79bb5c4a-327b-4369-8efb-2cd798838aae\") " pod="openshift-network-operator/iptables-alerter-6lkk9" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605418 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-multus-cni-dir\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605456 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-registration-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605490 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-sysctl-conf\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605521 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-cni-netd\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605543 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-lib-modules\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605569 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-systemd-units\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605596 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-run-multus-certs\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605628 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f162015f-478c-442a-a3c7-f85f6eefc4fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605651 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq95b\" (UniqueName: \"kubernetes.io/projected/f162015f-478c-442a-a3c7-f85f6eefc4fa-kube-api-access-jq95b\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605675 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-device-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605714 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7c33fe7-5b31-459b-bede-8164c9bec386-env-overrides\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.605754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605738 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7c33fe7-5b31-459b-bede-8164c9bec386-ovnkube-script-lib\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605761 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2813a209-455f-4de6-9786-a7977764c26b-multus-daemon-config\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605782 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-systemd\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605806 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-var-lib-kubelet\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605838 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bb5c4a-327b-4369-8efb-2cd798838aae-host-slash\") pod \"iptables-alerter-6lkk9\" (UID: \"79bb5c4a-327b-4369-8efb-2cd798838aae\") " pod="openshift-network-operator/iptables-alerter-6lkk9" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605862 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-run-netns\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605891 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-var-lib-openvswitch\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605915 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7c33fe7-5b31-459b-bede-8164c9bec386-ovnkube-config\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605938 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.605962 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-os-release\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606064 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-var-lib-kubelet\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606103 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-slash\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606140 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c606e9e5-8010-44dc-9a0e-8d4656eb495a-kubelet-config\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606165 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c606e9e5-8010-44dc-9a0e-8d4656eb495a-dbus\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606194 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-run-netns\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606229 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-host\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.606406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606268 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-kubelet\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606296 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f162015f-478c-442a-a3c7-f85f6eefc4fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606320 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-run-systemd\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606348 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-node-log\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606373 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-os-release\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606395 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-sys-fs\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606416 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-kubernetes\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606435 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-sysctl-d\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606461 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606491 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-cnibin\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606523 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f162015f-478c-442a-a3c7-f85f6eefc4fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606567 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-tuned\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606594 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-run-openvswitch\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606616 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-cni-bin\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606641 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-cnibin\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606666 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-multus-socket-dir-parent\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.607159 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606689 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-var-lib-cni-multus\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.607968 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606725 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-socket-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.607968 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606748 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg4jl\" (UniqueName: \"kubernetes.io/projected/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-kube-api-access-rg4jl\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.607968 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606814 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gncqh\" (UniqueName: \"kubernetes.io/projected/2813a209-455f-4de6-9786-a7977764c26b-kube-api-access-gncqh\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.607968 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606841 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-hostroot\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.607968 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606864 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.607968 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.606892 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-run\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.607968 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.607099 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-log-socket\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.607968 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.607133 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqwtc\" (UniqueName: \"kubernetes.io/projected/d7c33fe7-5b31-459b-bede-8164c9bec386-kube-api-access-sqwtc\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.607968 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.607355 2517 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 10:29:02.608596 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.608579 2517 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:29:02.632431 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.632414 2517 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzrhn" Jul 29 10:29:02.642434 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.640800 2517 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzrhn" Jul 29 10:29:02.696111 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.696084 2517 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 10:29:02.707304 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707274 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/098abb85-fffa-4b88-a3c4-965f8b699caf-serviceca\") pod \"node-ca-shzv5\" (UID: \"098abb85-fffa-4b88-a3c4-965f8b699caf\") " pod="openshift-image-registry/node-ca-shzv5" Jul 29 10:29:02.707425 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707317 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwfgv\" (UniqueName: \"kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv\") pod \"network-check-target-mrgw4\" (UID: \"e7963bf2-2e04-413b-b2f7-38f3bf858b53\") " pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:02.707425 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707393 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-run-netns\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.707531 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707433 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-host\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.707531 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707462 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-kubelet\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.707531 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707492 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2k2f\" (UniqueName: \"kubernetes.io/projected/098abb85-fffa-4b88-a3c4-965f8b699caf-kube-api-access-f2k2f\") pod \"node-ca-shzv5\" (UID: \"098abb85-fffa-4b88-a3c4-965f8b699caf\") " pod="openshift-image-registry/node-ca-shzv5" Jul 29 10:29:02.707754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707516 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-run-netns\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.707754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707522 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f162015f-478c-442a-a3c7-f85f6eefc4fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.707754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707572 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-run-systemd\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.707754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707597 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-node-log\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.707754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707621 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-os-release\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.707754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707643 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-sys-fs\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.707754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707660 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-run-systemd\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.707754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707670 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-kubernetes\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.707754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707710 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-sysctl-d\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.707754 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707749 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707779 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-cnibin\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707801 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f162015f-478c-442a-a3c7-f85f6eefc4fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707826 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-tuned\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707853 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-run-openvswitch\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707877 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-cni-bin\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707919 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-cnibin\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707924 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-kubelet\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707943 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-multus-socket-dir-parent\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707967 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-var-lib-cni-multus\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707971 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-host\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707996 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-socket-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708025 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-os-release\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708095 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-sys-fs\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708104 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-cnibin\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.708116 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708137 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-node-log\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708145 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73554e56-a2c1-4012-b7af-425b2f86ba7c-hosts-file\") pod \"node-resolver-7rkjp\" (UID: \"73554e56-a2c1-4012-b7af-425b2f86ba7c\") " pod="openshift-dns/node-resolver-7rkjp" Jul 29 10:29:02.708253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707892 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-kubernetes\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.707840 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-sysctl-d\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708200 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f162015f-478c-442a-a3c7-f85f6eefc4fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708228 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-socket-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.708205 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret podName:c606e9e5-8010-44dc-9a0e-8d4656eb495a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:03.208171768 +0000 UTC m=+2.958070407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret") pod "global-pull-secret-syncer-72csv" (UID: "c606e9e5-8010-44dc-9a0e-8d4656eb495a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708274 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg4jl\" (UniqueName: \"kubernetes.io/projected/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-kube-api-access-rg4jl\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708302 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gncqh\" (UniqueName: \"kubernetes.io/projected/2813a209-455f-4de6-9786-a7977764c26b-kube-api-access-gncqh\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708327 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-hostroot\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708348 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708387 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dh74\" (UniqueName: \"kubernetes.io/projected/73554e56-a2c1-4012-b7af-425b2f86ba7c-kube-api-access-5dh74\") pod \"node-resolver-7rkjp\" (UID: \"73554e56-a2c1-4012-b7af-425b2f86ba7c\") " pod="openshift-dns/node-resolver-7rkjp" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708413 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-run\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708446 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-multus-socket-dir-parent\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708495 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-log-socket\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708522 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqwtc\" (UniqueName: \"kubernetes.io/projected/d7c33fe7-5b31-459b-bede-8164c9bec386-kube-api-access-sqwtc\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708548 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/098abb85-fffa-4b88-a3c4-965f8b699caf-host\") pod \"node-ca-shzv5\" (UID: \"098abb85-fffa-4b88-a3c4-965f8b699caf\") " pod="openshift-image-registry/node-ca-shzv5" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708574 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-system-cni-dir\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.709123 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708598 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-multus-conf-dir\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708601 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-run-openvswitch\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708621 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-etc-kubernetes\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708635 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f162015f-478c-442a-a3c7-f85f6eefc4fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708645 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-cni-bin\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708651 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn4w4\" (UniqueName: \"kubernetes.io/projected/79bb5c4a-327b-4369-8efb-2cd798838aae-kube-api-access-qn4w4\") pod \"iptables-alerter-6lkk9\" (UID: \"79bb5c4a-327b-4369-8efb-2cd798838aae\") " pod="openshift-network-operator/iptables-alerter-6lkk9" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708682 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-run-ovn\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708716 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-run\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708725 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708748 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-hostroot\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708752 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708766 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-var-lib-cni-multus\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708765 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708776 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-etc-openvswitch\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708783 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-cnibin\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708815 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708818 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-etc-openvswitch\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708724 2517 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 10:29:02.709986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708910 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-run-k8s-cni-cncf-io\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708940 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-var-lib-cni-bin\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708962 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-log-socket\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.708968 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-sysconfig\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709023 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-multus-conf-dir\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709051 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-sysconfig\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709068 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-system-cni-dir\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709086 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-etc-kubernetes\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709114 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709123 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709144 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-run-k8s-cni-cncf-io\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709165 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7c33fe7-5b31-459b-bede-8164c9bec386-ovn-node-metrics-cert\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709186 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-var-lib-cni-bin\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709196 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z792\" (UniqueName: \"kubernetes.io/projected/3b2b8b47-f121-4b15-8595-7152e2d10091-kube-api-access-8z792\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709198 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709246 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709250 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-run-ovn\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.710858 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709275 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-system-cni-dir\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709302 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2813a209-455f-4de6-9786-a7977764c26b-cni-binary-copy\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709276 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f162015f-478c-442a-a3c7-f85f6eefc4fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709349 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0983da81-073a-4164-baf4-f710b75e71a7-agent-certs\") pod \"konnectivity-agent-gxscm\" (UID: \"0983da81-073a-4164-baf4-f710b75e71a7\") " pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709375 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0983da81-073a-4164-baf4-f710b75e71a7-konnectivity-ca\") pod \"konnectivity-agent-gxscm\" (UID: \"0983da81-073a-4164-baf4-f710b75e71a7\") " pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709401 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djd96\" (UniqueName: \"kubernetes.io/projected/728d6962-e152-46c0-aa2d-a447848c9bcd-kube-api-access-djd96\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709438 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-system-cni-dir\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709469 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-modprobe-d\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709485 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-sys\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709507 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-tmp\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709533 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79bb5c4a-327b-4369-8efb-2cd798838aae-iptables-alerter-script\") pod \"iptables-alerter-6lkk9\" (UID: \"79bb5c4a-327b-4369-8efb-2cd798838aae\") " pod="openshift-network-operator/iptables-alerter-6lkk9" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709789 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-modprobe-d\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709837 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-sys\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.709999 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2813a209-455f-4de6-9786-a7977764c26b-cni-binary-copy\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710205 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-multus-cni-dir\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710244 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-registration-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710269 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-sysctl-conf\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710306 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-cni-netd\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.711666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710331 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-lib-modules\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710355 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-systemd-units\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710382 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-run-multus-certs\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710427 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f162015f-478c-442a-a3c7-f85f6eefc4fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710472 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq95b\" (UniqueName: \"kubernetes.io/projected/f162015f-478c-442a-a3c7-f85f6eefc4fa-kube-api-access-jq95b\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710499 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-device-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710537 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7c33fe7-5b31-459b-bede-8164c9bec386-env-overrides\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710567 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7c33fe7-5b31-459b-bede-8164c9bec386-ovnkube-script-lib\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710594 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2813a209-455f-4de6-9786-a7977764c26b-multus-daemon-config\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710618 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-systemd\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710648 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79bb5c4a-327b-4369-8efb-2cd798838aae-iptables-alerter-script\") pod \"iptables-alerter-6lkk9\" (UID: \"79bb5c4a-327b-4369-8efb-2cd798838aae\") " pod="openshift-network-operator/iptables-alerter-6lkk9" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710667 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-var-lib-kubelet\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710753 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bb5c4a-327b-4369-8efb-2cd798838aae-host-slash\") pod \"iptables-alerter-6lkk9\" (UID: \"79bb5c4a-327b-4369-8efb-2cd798838aae\") " pod="openshift-network-operator/iptables-alerter-6lkk9" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710778 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-run-netns\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710805 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-var-lib-openvswitch\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710831 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7c33fe7-5b31-459b-bede-8164c9bec386-ovnkube-config\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710855 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:02.713113 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710889 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-os-release\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710916 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-var-lib-kubelet\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710943 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-slash\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.710975 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c606e9e5-8010-44dc-9a0e-8d4656eb495a-kubelet-config\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711002 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c606e9e5-8010-44dc-9a0e-8d4656eb495a-dbus\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711033 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73554e56-a2c1-4012-b7af-425b2f86ba7c-tmp-dir\") pod \"node-resolver-7rkjp\" (UID: \"73554e56-a2c1-4012-b7af-425b2f86ba7c\") " pod="openshift-dns/node-resolver-7rkjp" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711122 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0983da81-073a-4164-baf4-f710b75e71a7-konnectivity-ca\") pod \"konnectivity-agent-gxscm\" (UID: \"0983da81-073a-4164-baf4-f710b75e71a7\") " pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711173 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-var-lib-kubelet\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711238 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-systemd\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711285 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bb5c4a-327b-4369-8efb-2cd798838aae-host-slash\") pod \"iptables-alerter-6lkk9\" (UID: \"79bb5c4a-327b-4369-8efb-2cd798838aae\") " pod="openshift-network-operator/iptables-alerter-6lkk9" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711320 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-run-netns\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711359 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-var-lib-openvswitch\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711630 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2813a209-455f-4de6-9786-a7977764c26b-multus-daemon-config\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711675 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-run-multus-certs\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711777 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-sysctl-conf\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711841 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7c33fe7-5b31-459b-bede-8164c9bec386-ovnkube-config\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711871 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-multus-cni-dir\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711914 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-registration-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.713953 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.711918 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.711946 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-cni-netd\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.711974 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs podName:3b2b8b47-f121-4b15-8595-7152e2d10091 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:03.211957864 +0000 UTC m=+2.961856489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs") pod "network-metrics-daemon-hpzsh" (UID: "3b2b8b47-f121-4b15-8595-7152e2d10091") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.712013 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-lib-modules\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.712066 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-os-release\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.712092 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2813a209-455f-4de6-9786-a7977764c26b-host-var-lib-kubelet\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.712116 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-host-slash\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.712145 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c606e9e5-8010-44dc-9a0e-8d4656eb495a-kubelet-config\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.712190 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c606e9e5-8010-44dc-9a0e-8d4656eb495a-dbus\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.712216 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7c33fe7-5b31-459b-bede-8164c9bec386-systemd-units\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.712645 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f162015f-478c-442a-a3c7-f85f6eefc4fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.712738 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7c33fe7-5b31-459b-bede-8164c9bec386-ovn-node-metrics-cert\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.712822 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/728d6962-e152-46c0-aa2d-a447848c9bcd-device-dir\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.713083 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-etc-tuned\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.713432 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7c33fe7-5b31-459b-bede-8164c9bec386-env-overrides\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.713505 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7c33fe7-5b31-459b-bede-8164c9bec386-ovnkube-script-lib\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.713841 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-tmp\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.715372 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.714864 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0983da81-073a-4164-baf4-f710b75e71a7-agent-certs\") pod \"konnectivity-agent-gxscm\" (UID: \"0983da81-073a-4164-baf4-f710b75e71a7\") " pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:02.717362 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.717309 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg4jl\" (UniqueName: \"kubernetes.io/projected/dc2bb501-1b1d-494d-b3e2-e4c0062e5793-kube-api-access-rg4jl\") pod \"tuned-qv2zf\" (UID: \"dc2bb501-1b1d-494d-b3e2-e4c0062e5793\") " pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.720245 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.720227 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqwtc\" (UniqueName: \"kubernetes.io/projected/d7c33fe7-5b31-459b-bede-8164c9bec386-kube-api-access-sqwtc\") pod \"ovnkube-node-t7g4l\" (UID: \"d7c33fe7-5b31-459b-bede-8164c9bec386\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.723097 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.723078 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djd96\" (UniqueName: \"kubernetes.io/projected/728d6962-e152-46c0-aa2d-a447848c9bcd-kube-api-access-djd96\") pod \"aws-ebs-csi-driver-node-sqf7m\" (UID: \"728d6962-e152-46c0-aa2d-a447848c9bcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.724052 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.724007 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn4w4\" (UniqueName: \"kubernetes.io/projected/79bb5c4a-327b-4369-8efb-2cd798838aae-kube-api-access-qn4w4\") pod \"iptables-alerter-6lkk9\" (UID: \"79bb5c4a-327b-4369-8efb-2cd798838aae\") " pod="openshift-network-operator/iptables-alerter-6lkk9" Jul 29 10:29:02.724619 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.724595 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gncqh\" (UniqueName: \"kubernetes.io/projected/2813a209-455f-4de6-9786-a7977764c26b-kube-api-access-gncqh\") pod \"multus-s2wcl\" (UID: \"2813a209-455f-4de6-9786-a7977764c26b\") " pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.724906 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.724865 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq95b\" (UniqueName: \"kubernetes.io/projected/f162015f-478c-442a-a3c7-f85f6eefc4fa-kube-api-access-jq95b\") pod \"multus-additional-cni-plugins-k6gbl\" (UID: \"f162015f-478c-442a-a3c7-f85f6eefc4fa\") " pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.727679 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.727655 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z792\" (UniqueName: \"kubernetes.io/projected/3b2b8b47-f121-4b15-8595-7152e2d10091-kube-api-access-8z792\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:02.768660 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.768634 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" event={"ID":"52d45821e2c58c5f03e9cafc844c27d5","Type":"ContainerStarted","Data":"6329283b7ff5f3347a7d888682b52557f3a72b6e1b984c11aab0d242c447f91d"} Jul 29 10:29:02.812353 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.812078 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73554e56-a2c1-4012-b7af-425b2f86ba7c-hosts-file\") pod \"node-resolver-7rkjp\" (UID: \"73554e56-a2c1-4012-b7af-425b2f86ba7c\") " pod="openshift-dns/node-resolver-7rkjp" Jul 29 10:29:02.812353 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.812163 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dh74\" (UniqueName: \"kubernetes.io/projected/73554e56-a2c1-4012-b7af-425b2f86ba7c-kube-api-access-5dh74\") pod \"node-resolver-7rkjp\" (UID: \"73554e56-a2c1-4012-b7af-425b2f86ba7c\") " pod="openshift-dns/node-resolver-7rkjp" Jul 29 10:29:02.812353 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.812197 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/098abb85-fffa-4b88-a3c4-965f8b699caf-host\") pod \"node-ca-shzv5\" (UID: \"098abb85-fffa-4b88-a3c4-965f8b699caf\") " pod="openshift-image-registry/node-ca-shzv5" Jul 29 10:29:02.812353 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.812235 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73554e56-a2c1-4012-b7af-425b2f86ba7c-hosts-file\") pod \"node-resolver-7rkjp\" (UID: \"73554e56-a2c1-4012-b7af-425b2f86ba7c\") " pod="openshift-dns/node-resolver-7rkjp" Jul 29 10:29:02.812353 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.812303 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/098abb85-fffa-4b88-a3c4-965f8b699caf-host\") pod \"node-ca-shzv5\" (UID: \"098abb85-fffa-4b88-a3c4-965f8b699caf\") " pod="openshift-image-registry/node-ca-shzv5" Jul 29 10:29:02.812650 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.812621 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73554e56-a2c1-4012-b7af-425b2f86ba7c-tmp-dir\") pod \"node-resolver-7rkjp\" (UID: \"73554e56-a2c1-4012-b7af-425b2f86ba7c\") " pod="openshift-dns/node-resolver-7rkjp" Jul 29 10:29:02.812716 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.812658 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/098abb85-fffa-4b88-a3c4-965f8b699caf-serviceca\") pod \"node-ca-shzv5\" (UID: \"098abb85-fffa-4b88-a3c4-965f8b699caf\") " pod="openshift-image-registry/node-ca-shzv5" Jul 29 10:29:02.812768 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.812720 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfgv\" (UniqueName: \"kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv\") pod \"network-check-target-mrgw4\" (UID: \"e7963bf2-2e04-413b-b2f7-38f3bf858b53\") " pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:02.812768 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.812762 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2k2f\" (UniqueName: \"kubernetes.io/projected/098abb85-fffa-4b88-a3c4-965f8b699caf-kube-api-access-f2k2f\") pod \"node-ca-shzv5\" (UID: \"098abb85-fffa-4b88-a3c4-965f8b699caf\") " pod="openshift-image-registry/node-ca-shzv5" Jul 29 10:29:02.814786 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.813328 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/098abb85-fffa-4b88-a3c4-965f8b699caf-serviceca\") pod \"node-ca-shzv5\" (UID: \"098abb85-fffa-4b88-a3c4-965f8b699caf\") " pod="openshift-image-registry/node-ca-shzv5" Jul 29 10:29:02.814786 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.813609 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73554e56-a2c1-4012-b7af-425b2f86ba7c-tmp-dir\") pod \"node-resolver-7rkjp\" (UID: \"73554e56-a2c1-4012-b7af-425b2f86ba7c\") " pod="openshift-dns/node-resolver-7rkjp" Jul 29 10:29:02.818544 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.818486 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:29:02.818544 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.818508 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:29:02.818544 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.818520 2517 projected.go:196] Error preparing data for projected volume kube-api-access-hwfgv for pod openshift-network-diagnostics/network-check-target-mrgw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:02.818772 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:02.818575 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv podName:e7963bf2-2e04-413b-b2f7-38f3bf858b53 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:03.318559262 +0000 UTC m=+3.068457891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hwfgv" (UniqueName: "kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv") pod "network-check-target-mrgw4" (UID: "e7963bf2-2e04-413b-b2f7-38f3bf858b53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:02.821335 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.821304 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2k2f\" (UniqueName: \"kubernetes.io/projected/098abb85-fffa-4b88-a3c4-965f8b699caf-kube-api-access-f2k2f\") pod \"node-ca-shzv5\" (UID: \"098abb85-fffa-4b88-a3c4-965f8b699caf\") " pod="openshift-image-registry/node-ca-shzv5" Jul 29 10:29:02.821335 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.821324 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dh74\" (UniqueName: \"kubernetes.io/projected/73554e56-a2c1-4012-b7af-425b2f86ba7c-kube-api-access-5dh74\") pod \"node-resolver-7rkjp\" (UID: \"73554e56-a2c1-4012-b7af-425b2f86ba7c\") " pod="openshift-dns/node-resolver-7rkjp" Jul 29 10:29:02.898652 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.898589 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k6gbl" Jul 29 10:29:02.907851 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.907826 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s2wcl" Jul 29 10:29:02.918582 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.918557 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:02.921283 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.921261 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" Jul 29 10:29:02.927954 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.927934 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" Jul 29 10:29:02.938643 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.938626 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6lkk9" Jul 29 10:29:02.955400 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.955378 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:02.962253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.962231 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7rkjp" Jul 29 10:29:02.966924 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:02.966896 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-shzv5" Jul 29 10:29:03.216827 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.216746 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:03.216990 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.216901 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:03.216990 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:03.216910 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:03.216990 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:03.216958 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:03.217129 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:03.217031 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs podName:3b2b8b47-f121-4b15-8595-7152e2d10091 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:04.217009041 +0000 UTC m=+3.966907678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs") pod "network-metrics-daemon-hpzsh" (UID: "3b2b8b47-f121-4b15-8595-7152e2d10091") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:03.217129 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:03.217053 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret podName:c606e9e5-8010-44dc-9a0e-8d4656eb495a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:04.217042352 +0000 UTC m=+3.966940970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret") pod "global-pull-secret-syncer-72csv" (UID: "c606e9e5-8010-44dc-9a0e-8d4656eb495a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:03.418450 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.418409 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfgv\" (UniqueName: \"kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv\") pod \"network-check-target-mrgw4\" (UID: \"e7963bf2-2e04-413b-b2f7-38f3bf858b53\") " pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:03.418613 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:03.418575 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:29:03.418613 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:03.418596 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:29:03.418613 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:03.418607 2517 projected.go:196] Error preparing data for projected volume kube-api-access-hwfgv for pod openshift-network-diagnostics/network-check-target-mrgw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:03.418769 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:03.418679 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv podName:e7963bf2-2e04-413b-b2f7-38f3bf858b53 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:04.418657647 +0000 UTC m=+4.168556265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwfgv" (UniqueName: "kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv") pod "network-check-target-mrgw4" (UID: "e7963bf2-2e04-413b-b2f7-38f3bf858b53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:03.644273 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.644246 2517 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 10:24:02 +0000 UTC" deadline="2027-12-24 07:37:14.162273748 +0000 UTC" Jul 29 10:29:03.644616 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.644274 2517 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12309h8m10.518003469s" Jul 29 10:29:03.657010 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:29:03.656982 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728d6962_e152_46c0_aa2d_a447848c9bcd.slice/crio-b594ce603f9419c75c45c9239763590b441ef8997959730c50aee960bc920d4a WatchSource:0}: Error finding container b594ce603f9419c75c45c9239763590b441ef8997959730c50aee960bc920d4a: Status 404 returned error can't find the container with id b594ce603f9419c75c45c9239763590b441ef8997959730c50aee960bc920d4a Jul 29 10:29:03.657801 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:29:03.657775 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf162015f_478c_442a_a3c7_f85f6eefc4fa.slice/crio-683dc30f1c99ca42580ef8919f3ab34f1ca80bdf5472aa2b6c18958cfbe47f5c WatchSource:0}: Error finding container 683dc30f1c99ca42580ef8919f3ab34f1ca80bdf5472aa2b6c18958cfbe47f5c: Status 404 returned error can't find the container with id 683dc30f1c99ca42580ef8919f3ab34f1ca80bdf5472aa2b6c18958cfbe47f5c Jul 29 10:29:03.658839 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:29:03.658819 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2813a209_455f_4de6_9786_a7977764c26b.slice/crio-605ce650421b96eb64553182bbd027a5b80a8390218cb2eeb4c583663033a902 WatchSource:0}: Error finding container 605ce650421b96eb64553182bbd027a5b80a8390218cb2eeb4c583663033a902: Status 404 returned error can't find the container with id 605ce650421b96eb64553182bbd027a5b80a8390218cb2eeb4c583663033a902 Jul 29 10:29:03.660889 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:29:03.660620 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0983da81_073a_4164_baf4_f710b75e71a7.slice/crio-f46624d577081dcb5c29ec4c935f849b9b6f65195d158c66801609cd7c0841f5 WatchSource:0}: Error finding container f46624d577081dcb5c29ec4c935f849b9b6f65195d158c66801609cd7c0841f5: Status 404 returned error can't find the container with id f46624d577081dcb5c29ec4c935f849b9b6f65195d158c66801609cd7c0841f5 Jul 29 10:29:03.661178 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:29:03.661140 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bb5c4a_327b_4369_8efb_2cd798838aae.slice/crio-e9d54bda4c16908d53a4607d5c4fb823500b5635d3e5b5e44bd90b9f58951635 WatchSource:0}: Error finding container e9d54bda4c16908d53a4607d5c4fb823500b5635d3e5b5e44bd90b9f58951635: Status 404 returned error can't find the container with id e9d54bda4c16908d53a4607d5c4fb823500b5635d3e5b5e44bd90b9f58951635 Jul 29 10:29:03.763816 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.763673 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:03.763938 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:03.763917 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:03.772156 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.772118 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" event={"ID":"dc2bb501-1b1d-494d-b3e2-e4c0062e5793","Type":"ContainerStarted","Data":"d5ab9805ebdca1c37ffe5bd30b365f33feb757237dc8de846140da00932e7fca"} Jul 29 10:29:03.773251 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.773202 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-shzv5" event={"ID":"098abb85-fffa-4b88-a3c4-965f8b699caf","Type":"ContainerStarted","Data":"9751a72e03f28c8d170a61f333228336d3f6f79543ca4ecfa99c899e05346120"} Jul 29 10:29:03.774466 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.774443 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s2wcl" event={"ID":"2813a209-455f-4de6-9786-a7977764c26b","Type":"ContainerStarted","Data":"605ce650421b96eb64553182bbd027a5b80a8390218cb2eeb4c583663033a902"} Jul 29 10:29:03.775483 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.775464 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gxscm" event={"ID":"0983da81-073a-4164-baf4-f710b75e71a7","Type":"ContainerStarted","Data":"f46624d577081dcb5c29ec4c935f849b9b6f65195d158c66801609cd7c0841f5"} Jul 29 10:29:03.776495 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.776478 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" event={"ID":"728d6962-e152-46c0-aa2d-a447848c9bcd","Type":"ContainerStarted","Data":"b594ce603f9419c75c45c9239763590b441ef8997959730c50aee960bc920d4a"} Jul 29 10:29:03.777584 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.777566 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7rkjp" event={"ID":"73554e56-a2c1-4012-b7af-425b2f86ba7c","Type":"ContainerStarted","Data":"220acf29d30950e3a1fd2be288c09aed8d10ac7fa05316a8674f37a36c8e624d"} Jul 29 10:29:03.779564 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.779542 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-43.ec2.internal" event={"ID":"2dd5713812e824284c4e3f717a7001f2","Type":"ContainerStarted","Data":"bbac1d3c080b008dffd0900004cb7d7afb2bd2f6fa2a39dcdf306b99e83e2bff"} Jul 29 10:29:03.780726 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.780686 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" event={"ID":"d7c33fe7-5b31-459b-bede-8164c9bec386","Type":"ContainerStarted","Data":"8ec581e809562c92a01fa267ad9a8bbedbafbfda2857b14d8988c23c75426f20"} Jul 29 10:29:03.781740 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.781723 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6lkk9" event={"ID":"79bb5c4a-327b-4369-8efb-2cd798838aae","Type":"ContainerStarted","Data":"e9d54bda4c16908d53a4607d5c4fb823500b5635d3e5b5e44bd90b9f58951635"} Jul 29 10:29:03.782897 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.782858 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k6gbl" event={"ID":"f162015f-478c-442a-a3c7-f85f6eefc4fa","Type":"ContainerStarted","Data":"683dc30f1c99ca42580ef8919f3ab34f1ca80bdf5472aa2b6c18958cfbe47f5c"} Jul 29 10:29:03.791968 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:03.791925 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-43.ec2.internal" podStartSLOduration=1.791913906 podStartE2EDuration="1.791913906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:03.791587441 +0000 UTC m=+3.541486074" watchObservedRunningTime="2026-07-29 10:29:03.791913906 +0000 UTC m=+3.541812540" Jul 29 10:29:04.225523 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:04.225488 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:04.225693 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:04.225560 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:04.225693 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:04.225675 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:04.225849 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:04.225748 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret podName:c606e9e5-8010-44dc-9a0e-8d4656eb495a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:06.225729877 +0000 UTC m=+5.975628492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret") pod "global-pull-secret-syncer-72csv" (UID: "c606e9e5-8010-44dc-9a0e-8d4656eb495a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:04.226163 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:04.226127 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:04.226235 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:04.226176 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs podName:3b2b8b47-f121-4b15-8595-7152e2d10091 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:06.226161426 +0000 UTC m=+5.976060053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs") pod "network-metrics-daemon-hpzsh" (UID: "3b2b8b47-f121-4b15-8595-7152e2d10091") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:04.426831 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:04.426798 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfgv\" (UniqueName: \"kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv\") pod \"network-check-target-mrgw4\" (UID: \"e7963bf2-2e04-413b-b2f7-38f3bf858b53\") " pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:04.427013 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:04.426975 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:29:04.427013 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:04.426996 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:29:04.427013 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:04.427010 2517 projected.go:196] Error preparing data for projected volume kube-api-access-hwfgv for pod openshift-network-diagnostics/network-check-target-mrgw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:04.427168 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:04.427071 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv podName:e7963bf2-2e04-413b-b2f7-38f3bf858b53 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:06.42705254 +0000 UTC m=+6.176951176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwfgv" (UniqueName: "kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv") pod "network-check-target-mrgw4" (UID: "e7963bf2-2e04-413b-b2f7-38f3bf858b53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:04.645258 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:04.645116 2517 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 10:24:02 +0000 UTC" deadline="2027-12-31 10:28:56.86744203 +0000 UTC" Jul 29 10:29:04.645258 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:04.645159 2517 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12479h59m52.22228778s" Jul 29 10:29:04.771902 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:04.771870 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:04.771902 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:04.771889 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:04.772117 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:04.772060 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:04.772592 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:04.772560 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:04.814762 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:04.814434 2517 generic.go:356] "Generic (PLEG): container finished" podID="52d45821e2c58c5f03e9cafc844c27d5" containerID="8c80e479bb1888718753abef5b76213e56cc40676251b57e039ad786ab1ee9a4" exitCode=0 Jul 29 10:29:04.814762 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:04.814521 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" event={"ID":"52d45821e2c58c5f03e9cafc844c27d5","Type":"ContainerDied","Data":"8c80e479bb1888718753abef5b76213e56cc40676251b57e039ad786ab1ee9a4"} Jul 29 10:29:05.764308 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:05.763783 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:05.764308 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:05.763913 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:05.834263 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:05.833572 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" event={"ID":"52d45821e2c58c5f03e9cafc844c27d5","Type":"ContainerStarted","Data":"6cbab36d800b47f1149742c8a7cf642ccd6cee7f39d7237407c3f65d05910776"} Jul 29 10:29:06.244376 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:06.243522 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:06.244376 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:06.243592 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:06.244376 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:06.243740 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:06.244376 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:06.243805 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret podName:c606e9e5-8010-44dc-9a0e-8d4656eb495a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:10.243785791 +0000 UTC m=+9.993684408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret") pod "global-pull-secret-syncer-72csv" (UID: "c606e9e5-8010-44dc-9a0e-8d4656eb495a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:06.244376 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:06.244186 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:06.244376 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:06.244237 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs podName:3b2b8b47-f121-4b15-8595-7152e2d10091 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:10.244220474 +0000 UTC m=+9.994119113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs") pod "network-metrics-daemon-hpzsh" (UID: "3b2b8b47-f121-4b15-8595-7152e2d10091") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:06.444736 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:06.444688 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfgv\" (UniqueName: \"kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv\") pod \"network-check-target-mrgw4\" (UID: \"e7963bf2-2e04-413b-b2f7-38f3bf858b53\") " pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:06.444956 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:06.444912 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:29:06.444956 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:06.444935 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:29:06.444956 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:06.444948 2517 projected.go:196] Error preparing data for projected volume kube-api-access-hwfgv for pod openshift-network-diagnostics/network-check-target-mrgw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:06.445105 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:06.445005 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv podName:e7963bf2-2e04-413b-b2f7-38f3bf858b53 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:10.444987724 +0000 UTC m=+10.194886365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwfgv" (UniqueName: "kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv") pod "network-check-target-mrgw4" (UID: "e7963bf2-2e04-413b-b2f7-38f3bf858b53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:06.764283 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:06.764255 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:06.764465 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:06.764401 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:06.764465 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:06.764255 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:06.764882 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:06.764494 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:07.763463 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:07.763422 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:07.763648 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:07.763556 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:08.763820 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:08.763786 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:08.764243 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:08.763897 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:08.764243 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:08.763951 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:08.764243 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:08.764029 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:09.763442 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:09.763405 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:09.763609 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:09.763538 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:10.276130 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:10.276069 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:10.276535 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:10.276167 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:10.276535 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:10.276224 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:10.276535 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:10.276273 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:10.276535 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:10.276305 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs podName:3b2b8b47-f121-4b15-8595-7152e2d10091 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:18.276284444 +0000 UTC m=+18.026183076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs") pod "network-metrics-daemon-hpzsh" (UID: "3b2b8b47-f121-4b15-8595-7152e2d10091") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:10.276535 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:10.276327 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret podName:c606e9e5-8010-44dc-9a0e-8d4656eb495a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:18.276316859 +0000 UTC m=+18.026215472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret") pod "global-pull-secret-syncer-72csv" (UID: "c606e9e5-8010-44dc-9a0e-8d4656eb495a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:10.477659 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:10.477627 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfgv\" (UniqueName: \"kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv\") pod \"network-check-target-mrgw4\" (UID: \"e7963bf2-2e04-413b-b2f7-38f3bf858b53\") " pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:10.477853 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:10.477798 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:29:10.477853 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:10.477820 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:29:10.477853 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:10.477832 2517 projected.go:196] Error preparing data for projected volume kube-api-access-hwfgv for pod openshift-network-diagnostics/network-check-target-mrgw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:10.478006 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:10.477889 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv podName:e7963bf2-2e04-413b-b2f7-38f3bf858b53 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:18.477871432 +0000 UTC m=+18.227770055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwfgv" (UniqueName: "kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv") pod "network-check-target-mrgw4" (UID: "e7963bf2-2e04-413b-b2f7-38f3bf858b53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:10.765165 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:10.764642 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:10.765165 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:10.764787 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:10.765165 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:10.764839 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:10.765165 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:10.764978 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:11.763979 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:11.763929 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:11.764517 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:11.764070 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:12.763863 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:12.763832 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:12.764028 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:12.763832 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:12.764028 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:12.763984 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:12.764426 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:12.764043 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:13.764042 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:13.764010 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:13.764197 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:13.764144 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:14.763885 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:14.763803 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:14.764021 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:14.763948 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:14.764090 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:14.764035 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:14.764168 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:14.764145 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:15.763532 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:15.763497 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:15.763922 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:15.763618 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:16.764053 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:16.764017 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:16.764493 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:16.764150 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:16.764493 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:16.764206 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:16.764493 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:16.764326 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:17.763670 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:17.763638 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:17.763902 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:17.763770 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:18.339639 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:18.339605 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:18.340127 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:18.339665 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:18.340127 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:18.339778 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:18.340127 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:18.339849 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret podName:c606e9e5-8010-44dc-9a0e-8d4656eb495a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:34.339829404 +0000 UTC m=+34.089728039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret") pod "global-pull-secret-syncer-72csv" (UID: "c606e9e5-8010-44dc-9a0e-8d4656eb495a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:18.340127 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:18.339778 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:18.340127 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:18.339900 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs podName:3b2b8b47-f121-4b15-8595-7152e2d10091 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:34.339887623 +0000 UTC m=+34.089786250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs") pod "network-metrics-daemon-hpzsh" (UID: "3b2b8b47-f121-4b15-8595-7152e2d10091") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:18.541446 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:18.541401 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfgv\" (UniqueName: \"kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv\") pod \"network-check-target-mrgw4\" (UID: \"e7963bf2-2e04-413b-b2f7-38f3bf858b53\") " pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:18.541626 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:18.541581 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:29:18.541626 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:18.541606 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:29:18.541626 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:18.541619 2517 projected.go:196] Error preparing data for projected volume kube-api-access-hwfgv for pod openshift-network-diagnostics/network-check-target-mrgw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:18.541816 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:18.541680 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv podName:e7963bf2-2e04-413b-b2f7-38f3bf858b53 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:34.54166196 +0000 UTC m=+34.291560587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwfgv" (UniqueName: "kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv") pod "network-check-target-mrgw4" (UID: "e7963bf2-2e04-413b-b2f7-38f3bf858b53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:18.763552 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:18.763475 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:18.763729 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:18.763600 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:18.763729 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:18.763638 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:18.763848 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:18.763739 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:19.763583 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:19.763546 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:19.764050 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:19.763670 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:20.764750 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:20.764686 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:20.765207 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:20.764834 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:20.765207 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:20.764887 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:20.765207 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:20.765003 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:21.764042 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:21.764010 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:21.764202 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:21.764118 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:22.763558 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.763344 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:22.764234 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.763370 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:22.764234 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:22.763678 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:22.764234 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:22.763761 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:22.864484 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.864454 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" event={"ID":"dc2bb501-1b1d-494d-b3e2-e4c0062e5793","Type":"ContainerStarted","Data":"dadce9a10d6a889d9a86e87e1037545125423dab92fb9b14ac6e47d73f219a90"} Jul 29 10:29:22.865760 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.865737 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-shzv5" event={"ID":"098abb85-fffa-4b88-a3c4-965f8b699caf","Type":"ContainerStarted","Data":"c671b371ac03634325e2577b8097fc3fa0e7b287c3bfb00ab9c8cffcc30cdf23"} Jul 29 10:29:22.867007 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.866989 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s2wcl" event={"ID":"2813a209-455f-4de6-9786-a7977764c26b","Type":"ContainerStarted","Data":"0388b299b0cfe3adb817b863377de604e60cfc05e1e4530836caf24cb85bba8d"} Jul 29 10:29:22.868250 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.868225 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gxscm" event={"ID":"0983da81-073a-4164-baf4-f710b75e71a7","Type":"ContainerStarted","Data":"71f4ae4c28df0fd2f465e869a18450c7357a5640fba943ae835a6f971b8656d6"} Jul 29 10:29:22.869662 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.869637 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" event={"ID":"728d6962-e152-46c0-aa2d-a447848c9bcd","Type":"ContainerStarted","Data":"6e21bb36983e16b303887272b3f06d466af46a3dc8e9b5649edf9f5ce8b36e39"} Jul 29 10:29:22.870961 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.870945 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7rkjp" event={"ID":"73554e56-a2c1-4012-b7af-425b2f86ba7c","Type":"ContainerStarted","Data":"930d3c9bacc47ab106108708a88dbe983a425b91e3971fe5f9fdb3a76f87ebd0"} Jul 29 10:29:22.872648 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.872631 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" event={"ID":"d7c33fe7-5b31-459b-bede-8164c9bec386","Type":"ContainerStarted","Data":"d8d8f3ea58ac17f4be7f10a487a8841baff38428c8b4e3edab903af4847a297c"} Jul 29 10:29:22.872752 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.872694 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" event={"ID":"d7c33fe7-5b31-459b-bede-8164c9bec386","Type":"ContainerStarted","Data":"40dfd2e537e7c5cade90ed0ca0f1592cef69b8970d64fe05ba1c045bfadc96d4"} Jul 29 10:29:22.874090 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.874067 2517 generic.go:356] "Generic (PLEG): container finished" podID="f162015f-478c-442a-a3c7-f85f6eefc4fa" containerID="e82547633fdaff32e05fcb9071877c3b70d2c6f10e20790ff996bff86f737a84" exitCode=0 Jul 29 10:29:22.874151 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.874102 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k6gbl" event={"ID":"f162015f-478c-442a-a3c7-f85f6eefc4fa","Type":"ContainerDied","Data":"e82547633fdaff32e05fcb9071877c3b70d2c6f10e20790ff996bff86f737a84"} Jul 29 10:29:22.882585 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.882551 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qv2zf" podStartSLOduration=4.199617274 podStartE2EDuration="22.882540095s" totalImagesPullingTime="18.682922821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:22.882075729 +0000 UTC m=+22.631974364" watchObservedRunningTime="2026-07-29 10:29:22.882540095 +0000 UTC m=+22.632438728" Jul 29 10:29:22.882675 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.882637 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-43.ec2.internal" podStartSLOduration=20.882633126 podStartE2EDuration="20.882633126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:05.850390108 +0000 UTC m=+5.600288746" watchObservedRunningTime="2026-07-29 10:29:22.882633126 +0000 UTC m=+22.632531760" Jul 29 10:29:22.896165 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.896109 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7rkjp" podStartSLOduration=4.203598676 podStartE2EDuration="22.896093654s" totalImagesPullingTime="18.692494978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:22.895875298 +0000 UTC m=+22.645773945" watchObservedRunningTime="2026-07-29 10:29:22.896093654 +0000 UTC m=+22.645992290" Jul 29 10:29:22.909003 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.908970 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-shzv5" podStartSLOduration=12.385643336 podStartE2EDuration="22.908959647s" totalImagesPullingTime="10.523316311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:22.908941602 +0000 UTC m=+22.658840235" watchObservedRunningTime="2026-07-29 10:29:22.908959647 +0000 UTC m=+22.658858281" Jul 29 10:29:22.948031 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.947996 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s2wcl" podStartSLOduration=4.250148694 podStartE2EDuration="22.947983538s" totalImagesPullingTime="18.697834844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:22.947472413 +0000 UTC m=+22.697371046" watchObservedRunningTime="2026-07-29 10:29:22.947983538 +0000 UTC m=+22.697882176" Jul 29 10:29:22.964531 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:22.964483 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gxscm" podStartSLOduration=4.278590689 podStartE2EDuration="22.964467319s" totalImagesPullingTime="18.68587663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:22.963973505 +0000 UTC m=+22.713872139" watchObservedRunningTime="2026-07-29 10:29:22.964467319 +0000 UTC m=+22.714365954" Jul 29 10:29:23.750138 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.749992 2517 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 10:29:23.763559 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.763532 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:23.763676 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:23.763634 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:23.878886 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.878800 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" event={"ID":"728d6962-e152-46c0-aa2d-a447848c9bcd","Type":"ContainerStarted","Data":"f79eaea5f9504ca7963efc2aa3a62b1636a26b731d1937674693ebf6d35b316f"} Jul 29 10:29:23.881912 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.881884 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:29:23.882307 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.882278 2517 generic.go:356] "Generic (PLEG): container finished" podID="d7c33fe7-5b31-459b-bede-8164c9bec386" containerID="d8d8f3ea58ac17f4be7f10a487a8841baff38428c8b4e3edab903af4847a297c" exitCode=1 Jul 29 10:29:23.882424 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.882351 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" event={"ID":"d7c33fe7-5b31-459b-bede-8164c9bec386","Type":"ContainerDied","Data":"d8d8f3ea58ac17f4be7f10a487a8841baff38428c8b4e3edab903af4847a297c"} Jul 29 10:29:23.882483 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.882438 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" event={"ID":"d7c33fe7-5b31-459b-bede-8164c9bec386","Type":"ContainerStarted","Data":"da55f55d63c8b08d8560562e291dca2fdb3e39ce775b920f89a89997f055f4da"} Jul 29 10:29:23.882537 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.882492 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" event={"ID":"d7c33fe7-5b31-459b-bede-8164c9bec386","Type":"ContainerStarted","Data":"5f834da9761d0847b0173d15029a9606f57495dd742961de8e8d0549e2db99d0"} Jul 29 10:29:23.882588 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.882542 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" event={"ID":"d7c33fe7-5b31-459b-bede-8164c9bec386","Type":"ContainerStarted","Data":"985229f660209f612fc334cf9829653b58a51cd9adf59f8ac0ca6b7fc4a05fa1"} Jul 29 10:29:23.882588 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.882585 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" event={"ID":"d7c33fe7-5b31-459b-bede-8164c9bec386","Type":"ContainerStarted","Data":"04e7af73f6f676aac4e4900e51eb26d8d6fde138cf88a7f22bc6d084740e82e5"} Jul 29 10:29:23.883934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.883909 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6lkk9" event={"ID":"79bb5c4a-327b-4369-8efb-2cd798838aae","Type":"ContainerStarted","Data":"0cdb0a1c189931980f0e01ead195bf866527d84d38dbb7151f67ac37ad00a2e4"} Jul 29 10:29:23.898108 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.898065 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6lkk9" podStartSLOduration=5.215900528 podStartE2EDuration="23.898045501s" totalImagesPullingTime="18.682144973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:23.897940879 +0000 UTC m=+23.647839512" watchObservedRunningTime="2026-07-29 10:29:23.898045501 +0000 UTC m=+23.647944136" Jul 29 10:29:23.973257 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.973231 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:23.974635 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:23.974617 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:24.677999 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:24.677895 2517 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T10:29:23.750130629Z","UUID":"9195ebf1-51a7-45d9-8244-3a53dc1236c6","Handler":null,"Name":"","Endpoint":""} Jul 29 10:29:24.679435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:24.679412 2517 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 10:29:24.679435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:24.679442 2517 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 10:29:24.764229 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:24.764199 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:24.764609 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:24.764199 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:24.764609 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:24.764346 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:24.764609 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:24.764398 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:24.887006 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:24.886801 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:24.887378 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:24.887340 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gxscm" Jul 29 10:29:25.764362 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:25.764169 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:25.764785 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:25.764482 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:25.893562 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:25.893485 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:29:25.893993 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:25.893961 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" event={"ID":"d7c33fe7-5b31-459b-bede-8164c9bec386","Type":"ContainerStarted","Data":"93d34da70e5be360b2901ce3ae05c17447bcaf9c0b9a42f5ee91c1aaef4b8a67"} Jul 29 10:29:25.896218 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:25.896190 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" event={"ID":"728d6962-e152-46c0-aa2d-a447848c9bcd","Type":"ContainerStarted","Data":"997b6d8b91005633eb6156f5b6d556bde076a2c10f9c8154fb9011718a3cfa6d"} Jul 29 10:29:25.917072 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:25.917017 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqf7m" podStartSLOduration=5.104464253 podStartE2EDuration="25.917001999s" totalImagesPullingTime="20.812537746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:25.916227879 +0000 UTC m=+25.666126539" watchObservedRunningTime="2026-07-29 10:29:25.917001999 +0000 UTC m=+25.666900634" Jul 29 10:29:26.763318 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:26.763286 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:26.763525 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:26.763370 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:26.763525 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:26.763458 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:26.763646 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:26.763582 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:27.763901 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:27.763853 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:27.765069 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:27.763954 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:27.905197 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:27.905015 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:29:27.905554 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:27.905522 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" event={"ID":"d7c33fe7-5b31-459b-bede-8164c9bec386","Type":"ContainerStarted","Data":"4db35497603e757aa48e8f0dbb50a4d0ae53a9c8190293f7e1d3b1e32abcee0a"} Jul 29 10:29:27.905844 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:27.905797 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:27.906014 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:27.905998 2517 scope.go:117] "RemoveContainer" containerID="d8d8f3ea58ac17f4be7f10a487a8841baff38428c8b4e3edab903af4847a297c" Jul 29 10:29:27.908181 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:27.908156 2517 generic.go:356] "Generic (PLEG): container finished" podID="f162015f-478c-442a-a3c7-f85f6eefc4fa" containerID="b01b480d35dd4218308a778aa639daa2ed3d861c027307fdc1fc6376e1cb69ca" exitCode=0 Jul 29 10:29:27.908299 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:27.908197 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k6gbl" event={"ID":"f162015f-478c-442a-a3c7-f85f6eefc4fa","Type":"ContainerDied","Data":"b01b480d35dd4218308a778aa639daa2ed3d861c027307fdc1fc6376e1cb69ca"} Jul 29 10:29:27.923150 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:27.923131 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:28.764041 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:28.764003 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:28.764041 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:28.764007 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:28.764449 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:28.764122 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:28.764449 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:28.764202 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:28.913360 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:28.913301 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:29:28.913651 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:28.913630 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" event={"ID":"d7c33fe7-5b31-459b-bede-8164c9bec386","Type":"ContainerStarted","Data":"de75ce2904033af2e006501d83c370e2d7a85ea6bbb177b069a626cf9bfd9846"} Jul 29 10:29:28.913847 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:28.913832 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:28.913919 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:28.913892 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:28.929391 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:28.929372 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:29:28.955744 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:28.955689 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" podStartSLOduration=10.054642797 podStartE2EDuration="28.955675134s" totalImagesPullingTime="18.901032337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:28.955563627 +0000 UTC m=+28.705462278" watchObservedRunningTime="2026-07-29 10:29:28.955675134 +0000 UTC m=+28.705573769" Jul 29 10:29:29.747610 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:29.747577 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-72csv"] Jul 29 10:29:29.747835 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:29.747688 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:29.747835 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:29.747808 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:29.750857 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:29.750831 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mrgw4"] Jul 29 10:29:29.750990 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:29.750945 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:29.751068 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:29.751045 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:29.751461 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:29.751441 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hpzsh"] Jul 29 10:29:29.751566 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:29.751527 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:29.751639 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:29.751624 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:29.918330 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:29.918245 2517 generic.go:356] "Generic (PLEG): container finished" podID="f162015f-478c-442a-a3c7-f85f6eefc4fa" containerID="522abf016c5a9dafccfd0a2ec86314cdacda23e07cd445701b703a8f60ad334b" exitCode=0 Jul 29 10:29:29.918818 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:29.918331 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k6gbl" event={"ID":"f162015f-478c-442a-a3c7-f85f6eefc4fa","Type":"ContainerDied","Data":"522abf016c5a9dafccfd0a2ec86314cdacda23e07cd445701b703a8f60ad334b"} Jul 29 10:29:31.763993 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:31.763847 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:31.764395 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:31.763917 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:31.764395 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:31.764078 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:31.764395 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:31.764183 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:31.764395 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:31.763927 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:31.764395 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:31.764284 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:31.925690 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:31.925653 2517 generic.go:356] "Generic (PLEG): container finished" podID="f162015f-478c-442a-a3c7-f85f6eefc4fa" containerID="a8c772b494a38cf4e19038056dc94df30542e79b41fa6cc31b41ce476e6a7480" exitCode=0 Jul 29 10:29:31.925833 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:31.925712 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k6gbl" event={"ID":"f162015f-478c-442a-a3c7-f85f6eefc4fa","Type":"ContainerDied","Data":"a8c772b494a38cf4e19038056dc94df30542e79b41fa6cc31b41ce476e6a7480"} Jul 29 10:29:33.763271 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:33.763236 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:33.763881 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:33.763345 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:33.763881 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:33.763357 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72csv" podUID="c606e9e5-8010-44dc-9a0e-8d4656eb495a" Jul 29 10:29:33.763881 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:33.763366 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:33.763881 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:33.763416 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrgw4" podUID="e7963bf2-2e04-413b-b2f7-38f3bf858b53" Jul 29 10:29:33.763881 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:33.763527 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpzsh" podUID="3b2b8b47-f121-4b15-8595-7152e2d10091" Jul 29 10:29:34.354900 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:34.354384 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:34.354900 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:34.354449 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:34.354900 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:34.354559 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:34.354900 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:34.354616 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs podName:3b2b8b47-f121-4b15-8595-7152e2d10091 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:06.354595876 +0000 UTC m=+66.104494506 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs") pod "network-metrics-daemon-hpzsh" (UID: "3b2b8b47-f121-4b15-8595-7152e2d10091") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:34.354900 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:34.354905 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:34.355229 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:34.354968 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret podName:c606e9e5-8010-44dc-9a0e-8d4656eb495a nodeName:}" failed. No retries permitted until 2026-07-29 10:30:06.354950005 +0000 UTC m=+66.104848626 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret") pod "global-pull-secret-syncer-72csv" (UID: "c606e9e5-8010-44dc-9a0e-8d4656eb495a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:34.556286 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:34.556250 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfgv\" (UniqueName: \"kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv\") pod \"network-check-target-mrgw4\" (UID: \"e7963bf2-2e04-413b-b2f7-38f3bf858b53\") " pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:34.556455 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:34.556433 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:29:34.556521 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:34.556457 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:29:34.556521 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:34.556469 2517 projected.go:196] Error preparing data for projected volume kube-api-access-hwfgv for pod openshift-network-diagnostics/network-check-target-mrgw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:34.556618 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:34.556537 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv podName:e7963bf2-2e04-413b-b2f7-38f3bf858b53 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:06.556518803 +0000 UTC m=+66.306417431 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwfgv" (UniqueName: "kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv") pod "network-check-target-mrgw4" (UID: "e7963bf2-2e04-413b-b2f7-38f3bf858b53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:35.036358 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.036323 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-43.ec2.internal" event="NodeReady" Jul 29 10:29:35.036912 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.036462 2517 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 10:29:35.080263 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.080237 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8vq7d"] Jul 29 10:29:35.083032 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.082984 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.083594 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.083568 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v6wqm"] Jul 29 10:29:35.084977 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.084917 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 10:29:35.085107 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.085055 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 10:29:35.085107 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.085055 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hm7tz\"" Jul 29 10:29:35.085635 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.085612 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v6wqm" Jul 29 10:29:35.087197 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.087178 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 10:29:35.087792 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.087470 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 10:29:35.087792 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.087550 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9bsc6\"" Jul 29 10:29:35.087792 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.087470 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 10:29:35.094289 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.094269 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vq7d"] Jul 29 10:29:35.096445 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.096425 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v6wqm"] Jul 29 10:29:35.160193 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.160125 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3a8551b-8b94-462f-acc1-09f58220aa32-tmp-dir\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.160193 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.160170 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5s6j\" (UniqueName: \"kubernetes.io/projected/c3a8551b-8b94-462f-acc1-09f58220aa32-kube-api-access-r5s6j\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.160341 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.160255 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbt7m\" (UniqueName: \"kubernetes.io/projected/8ef268b1-5b59-4dae-950b-8695dd350841-kube-api-access-cbt7m\") pod \"ingress-canary-v6wqm\" (UID: \"8ef268b1-5b59-4dae-950b-8695dd350841\") " pod="openshift-ingress-canary/ingress-canary-v6wqm" Jul 29 10:29:35.160341 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.160281 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a8551b-8b94-462f-acc1-09f58220aa32-config-volume\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.160341 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.160305 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.160341 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.160328 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ef268b1-5b59-4dae-950b-8695dd350841-cert\") pod \"ingress-canary-v6wqm\" (UID: \"8ef268b1-5b59-4dae-950b-8695dd350841\") " pod="openshift-ingress-canary/ingress-canary-v6wqm" Jul 29 10:29:35.261651 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.261613 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbt7m\" (UniqueName: \"kubernetes.io/projected/8ef268b1-5b59-4dae-950b-8695dd350841-kube-api-access-cbt7m\") pod \"ingress-canary-v6wqm\" (UID: \"8ef268b1-5b59-4dae-950b-8695dd350841\") " pod="openshift-ingress-canary/ingress-canary-v6wqm" Jul 29 10:29:35.261813 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.261658 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a8551b-8b94-462f-acc1-09f58220aa32-config-volume\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.261813 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.261682 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.261813 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:35.261793 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:35.261960 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.261827 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ef268b1-5b59-4dae-950b-8695dd350841-cert\") pod \"ingress-canary-v6wqm\" (UID: \"8ef268b1-5b59-4dae-950b-8695dd350841\") " pod="openshift-ingress-canary/ingress-canary-v6wqm" Jul 29 10:29:35.261960 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.261913 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3a8551b-8b94-462f-acc1-09f58220aa32-tmp-dir\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.261960 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.261941 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5s6j\" (UniqueName: \"kubernetes.io/projected/c3a8551b-8b94-462f-acc1-09f58220aa32-kube-api-access-r5s6j\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.262102 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:35.262024 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls podName:c3a8551b-8b94-462f-acc1-09f58220aa32 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:35.762000737 +0000 UTC m=+35.511899348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls") pod "dns-default-8vq7d" (UID: "c3a8551b-8b94-462f-acc1-09f58220aa32") : secret "dns-default-metrics-tls" not found Jul 29 10:29:35.262272 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.262240 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3a8551b-8b94-462f-acc1-09f58220aa32-tmp-dir\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.262395 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.262297 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a8551b-8b94-462f-acc1-09f58220aa32-config-volume\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.266326 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.266280 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ef268b1-5b59-4dae-950b-8695dd350841-cert\") pod \"ingress-canary-v6wqm\" (UID: \"8ef268b1-5b59-4dae-950b-8695dd350841\") " pod="openshift-ingress-canary/ingress-canary-v6wqm" Jul 29 10:29:35.269982 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.269957 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5s6j\" (UniqueName: \"kubernetes.io/projected/c3a8551b-8b94-462f-acc1-09f58220aa32-kube-api-access-r5s6j\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.270390 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.270286 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbt7m\" (UniqueName: \"kubernetes.io/projected/8ef268b1-5b59-4dae-950b-8695dd350841-kube-api-access-cbt7m\") pod \"ingress-canary-v6wqm\" (UID: \"8ef268b1-5b59-4dae-950b-8695dd350841\") " pod="openshift-ingress-canary/ingress-canary-v6wqm" Jul 29 10:29:35.402531 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.402501 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v6wqm" Jul 29 10:29:35.763565 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.763342 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:29:35.763565 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.763550 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:29:35.763814 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.763548 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:29:35.765531 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.765509 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:35.765655 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:35.765634 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:35.765735 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:35.765689 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls podName:c3a8551b-8b94-462f-acc1-09f58220aa32 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:36.765671395 +0000 UTC m=+36.515570023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls") pod "dns-default-8vq7d" (UID: "c3a8551b-8b94-462f-acc1-09f58220aa32") : secret "dns-default-metrics-tls" not found Jul 29 10:29:35.765735 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.765716 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 10:29:35.765851 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.765732 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 10:29:35.766120 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.766104 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 10:29:35.766220 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.766128 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n9sqp\"" Jul 29 10:29:35.766220 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.766137 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 10:29:35.766220 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:35.766103 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2mpdj\"" Jul 29 10:29:36.089091 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:36.088973 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v6wqm"] Jul 29 10:29:36.094264 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:29:36.094244 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef268b1_5b59_4dae_950b_8695dd350841.slice/crio-e10697a7c73b5170b5fa342fbe30b678d5cf478739a6b103c0770c257452cd48 WatchSource:0}: Error finding container e10697a7c73b5170b5fa342fbe30b678d5cf478739a6b103c0770c257452cd48: Status 404 returned error can't find the container with id e10697a7c73b5170b5fa342fbe30b678d5cf478739a6b103c0770c257452cd48 Jul 29 10:29:36.774195 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:36.774168 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:36.774361 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:36.774295 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:36.774361 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:36.774357 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls podName:c3a8551b-8b94-462f-acc1-09f58220aa32 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:38.774340314 +0000 UTC m=+38.524238925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls") pod "dns-default-8vq7d" (UID: "c3a8551b-8b94-462f-acc1-09f58220aa32") : secret "dns-default-metrics-tls" not found Jul 29 10:29:36.940001 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:36.939966 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v6wqm" event={"ID":"8ef268b1-5b59-4dae-950b-8695dd350841","Type":"ContainerStarted","Data":"e10697a7c73b5170b5fa342fbe30b678d5cf478739a6b103c0770c257452cd48"} Jul 29 10:29:36.943241 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:36.943212 2517 generic.go:356] "Generic (PLEG): container finished" podID="f162015f-478c-442a-a3c7-f85f6eefc4fa" containerID="904a2bb59c9e558519fe50c61e320a18faba196e54b1fa0f496043be2684a2c3" exitCode=0 Jul 29 10:29:36.943386 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:36.943253 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k6gbl" event={"ID":"f162015f-478c-442a-a3c7-f85f6eefc4fa","Type":"ContainerDied","Data":"904a2bb59c9e558519fe50c61e320a18faba196e54b1fa0f496043be2684a2c3"} Jul 29 10:29:37.949151 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:37.949118 2517 generic.go:356] "Generic (PLEG): container finished" podID="f162015f-478c-442a-a3c7-f85f6eefc4fa" containerID="0e14a4b7c861ae2ce711b6f5b345c401a4485e0493083e8e539d0991d397060f" exitCode=0 Jul 29 10:29:37.949579 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:37.949162 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k6gbl" event={"ID":"f162015f-478c-442a-a3c7-f85f6eefc4fa","Type":"ContainerDied","Data":"0e14a4b7c861ae2ce711b6f5b345c401a4485e0493083e8e539d0991d397060f"} Jul 29 10:29:38.788923 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:38.788691 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:38.788923 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:38.788798 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:38.789124 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:38.788935 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls podName:c3a8551b-8b94-462f-acc1-09f58220aa32 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:42.788916789 +0000 UTC m=+42.538815411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls") pod "dns-default-8vq7d" (UID: "c3a8551b-8b94-462f-acc1-09f58220aa32") : secret "dns-default-metrics-tls" not found Jul 29 10:29:38.953253 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:38.953212 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v6wqm" event={"ID":"8ef268b1-5b59-4dae-950b-8695dd350841","Type":"ContainerStarted","Data":"80bc6f322f9781ce36a1e79110595b693f1e319842517409f748ddeab964050f"} Jul 29 10:29:38.956430 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:38.956405 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k6gbl" event={"ID":"f162015f-478c-442a-a3c7-f85f6eefc4fa","Type":"ContainerStarted","Data":"cab244b7c1e54bc9b77b8e024f16f760a9f96cce036bff34a2134454789c9ee9"} Jul 29 10:29:38.969659 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:38.969621 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v6wqm" podStartSLOduration=1.604279172 podStartE2EDuration="3.969608279s" totalImagesPullingTime="2.365329107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:38.969179589 +0000 UTC m=+38.719078234" watchObservedRunningTime="2026-07-29 10:29:38.969608279 +0000 UTC m=+38.719506935" Jul 29 10:29:38.991416 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:38.991370 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k6gbl" podStartSLOduration=9.795942477 podStartE2EDuration="38.991352441s" totalImagesPullingTime="29.195409964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:38.990100443 +0000 UTC m=+38.739999076" watchObservedRunningTime="2026-07-29 10:29:38.991352441 +0000 UTC m=+38.741251079" Jul 29 10:29:42.814649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:42.814613 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:42.815163 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:42.814730 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:42.815163 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:42.814780 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls podName:c3a8551b-8b94-462f-acc1-09f58220aa32 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:50.814766795 +0000 UTC m=+50.564665407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls") pod "dns-default-8vq7d" (UID: "c3a8551b-8b94-462f-acc1-09f58220aa32") : secret "dns-default-metrics-tls" not found Jul 29 10:29:50.871387 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:50.871352 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:29:50.871837 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:50.871460 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:50.871837 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:50.871515 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls podName:c3a8551b-8b94-462f-acc1-09f58220aa32 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:06.871502855 +0000 UTC m=+66.621401466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls") pod "dns-default-8vq7d" (UID: "c3a8551b-8b94-462f-acc1-09f58220aa32") : secret "dns-default-metrics-tls" not found Jul 29 10:29:55.094403 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.094365 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv"] Jul 29 10:29:55.096375 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.096358 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-f8d744b6c-jpktk"] Jul 29 10:29:55.096493 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.096475 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:55.098110 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.098089 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.098874 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.098850 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 10:29:55.099122 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.099102 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 10:29:55.099227 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.099102 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 29 10:29:55.101228 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.101175 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 29 10:29:55.101368 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.101344 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 29 10:29:55.101901 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.101883 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 10:29:55.102517 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.102431 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 10:29:55.102813 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.102775 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 29 10:29:55.103402 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.103379 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 29 10:29:55.103489 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.103416 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vrsl4\"" Jul 29 10:29:55.103489 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.103416 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-74pst\"" Jul 29 10:29:55.103732 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.103714 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 29 10:29:55.120547 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.120415 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f8d744b6c-jpktk"] Jul 29 10:29:55.121044 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.121025 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv"] Jul 29 10:29:55.178163 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.178138 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-w54dt"] Jul 29 10:29:55.179867 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.179853 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:29:55.182841 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.182819 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 29 10:29:55.182943 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.182876 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 29 10:29:55.182943 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.182889 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9qlwr\"" Jul 29 10:29:55.196551 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.196529 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-w54dt"] Jul 29 10:29:55.204145 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.204124 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:55.204245 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.204157 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/17d49008-e794-4257-bead-a90128ff8b2c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:55.204245 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.204179 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-default-certificate\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.204245 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.204209 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9wtx\" (UniqueName: \"kubernetes.io/projected/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-kube-api-access-m9wtx\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.204245 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.204227 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.204385 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.204259 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.204385 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.204329 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-stats-auth\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.204385 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.204362 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n69d9\" (UniqueName: \"kubernetes.io/projected/17d49008-e794-4257-bead-a90128ff8b2c-kube-api-access-n69d9\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:55.305211 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.305177 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9wtx\" (UniqueName: \"kubernetes.io/projected/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-kube-api-access-m9wtx\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.305211 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.305213 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.305419 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.305234 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.305419 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.305254 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-stats-auth\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.305419 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.305316 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41b34f49-8333-49eb-a1f1-ef9caca2088a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-w54dt\" (UID: \"41b34f49-8333-49eb-a1f1-ef9caca2088a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:29:55.305419 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.305358 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n69d9\" (UniqueName: \"kubernetes.io/projected/17d49008-e794-4257-bead-a90128ff8b2c-kube-api-access-n69d9\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:55.305419 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.305327 2517 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 10:29:55.305419 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.305409 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle podName:d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:55.805389013 +0000 UTC m=+55.555287656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle") pod "router-default-f8d744b6c-jpktk" (UID: "d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394") : configmap references non-existent config key: service-ca.crt Jul 29 10:29:55.305675 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.305441 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs podName:d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:55.805422077 +0000 UTC m=+55.555320709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs") pod "router-default-f8d744b6c-jpktk" (UID: "d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394") : secret "router-metrics-certs-default" not found Jul 29 10:29:55.305675 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.305515 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:55.305675 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.305545 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/17d49008-e794-4257-bead-a90128ff8b2c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:55.305675 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.305566 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-default-certificate\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.305675 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.305614 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-w54dt\" (UID: \"41b34f49-8333-49eb-a1f1-ef9caca2088a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:29:55.305675 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.305632 2517 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:55.305675 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.305676 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls podName:17d49008-e794-4257-bead-a90128ff8b2c nodeName:}" failed. No retries permitted until 2026-07-29 10:29:55.805663346 +0000 UTC m=+55.555561971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-86klv" (UID: "17d49008-e794-4257-bead-a90128ff8b2c") : secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:55.306335 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.306311 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/17d49008-e794-4257-bead-a90128ff8b2c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:55.309355 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.309334 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-stats-auth\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.309415 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.309334 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-default-certificate\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.336487 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.336460 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n69d9\" (UniqueName: \"kubernetes.io/projected/17d49008-e794-4257-bead-a90128ff8b2c-kube-api-access-n69d9\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:55.338384 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.338363 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9wtx\" (UniqueName: \"kubernetes.io/projected/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-kube-api-access-m9wtx\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.405940 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.405875 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-w54dt\" (UID: \"41b34f49-8333-49eb-a1f1-ef9caca2088a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:29:55.405940 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.405931 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41b34f49-8333-49eb-a1f1-ef9caca2088a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-w54dt\" (UID: \"41b34f49-8333-49eb-a1f1-ef9caca2088a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:29:55.406073 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.405998 2517 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 10:29:55.406073 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.406057 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert podName:41b34f49-8333-49eb-a1f1-ef9caca2088a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:55.906045011 +0000 UTC m=+55.655943623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-w54dt" (UID: "41b34f49-8333-49eb-a1f1-ef9caca2088a") : secret "networking-console-plugin-cert" not found Jul 29 10:29:55.406474 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.406458 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41b34f49-8333-49eb-a1f1-ef9caca2088a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-w54dt\" (UID: \"41b34f49-8333-49eb-a1f1-ef9caca2088a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:29:55.810256 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.810212 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:55.810470 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.810294 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.810470 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.810319 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:55.810470 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.810362 2517 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:55.810470 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.810425 2517 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 10:29:55.810470 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.810432 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls podName:17d49008-e794-4257-bead-a90128ff8b2c nodeName:}" failed. No retries permitted until 2026-07-29 10:29:56.810414919 +0000 UTC m=+56.560313531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-86klv" (UID: "17d49008-e794-4257-bead-a90128ff8b2c") : secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:55.810470 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.810462 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle podName:d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:56.810447884 +0000 UTC m=+56.560346499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle") pod "router-default-f8d744b6c-jpktk" (UID: "d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394") : configmap references non-existent config key: service-ca.crt Jul 29 10:29:55.810749 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.810489 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs podName:d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:56.81047923 +0000 UTC m=+56.560377842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs") pod "router-default-f8d744b6c-jpktk" (UID: "d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394") : secret "router-metrics-certs-default" not found Jul 29 10:29:55.911601 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:55.911554 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-w54dt\" (UID: \"41b34f49-8333-49eb-a1f1-ef9caca2088a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:29:55.911806 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.911693 2517 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 10:29:55.911806 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:55.911800 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert podName:41b34f49-8333-49eb-a1f1-ef9caca2088a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:56.911785411 +0000 UTC m=+56.661684023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-w54dt" (UID: "41b34f49-8333-49eb-a1f1-ef9caca2088a") : secret "networking-console-plugin-cert" not found Jul 29 10:29:56.818227 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:56.818197 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:56.818227 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:56.818227 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:56.818631 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:56.818289 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:56.818631 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:56.818344 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle podName:d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:58.818328333 +0000 UTC m=+58.568226944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle") pod "router-default-f8d744b6c-jpktk" (UID: "d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394") : configmap references non-existent config key: service-ca.crt Jul 29 10:29:56.818631 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:56.818398 2517 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:56.818631 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:56.818443 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls podName:17d49008-e794-4257-bead-a90128ff8b2c nodeName:}" failed. No retries permitted until 2026-07-29 10:29:58.818432626 +0000 UTC m=+58.568331238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-86klv" (UID: "17d49008-e794-4257-bead-a90128ff8b2c") : secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:56.818631 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:56.818398 2517 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 10:29:56.818631 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:56.818475 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs podName:d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:58.818465997 +0000 UTC m=+58.568364610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs") pod "router-default-f8d744b6c-jpktk" (UID: "d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394") : secret "router-metrics-certs-default" not found Jul 29 10:29:56.919105 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:56.919073 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-w54dt\" (UID: \"41b34f49-8333-49eb-a1f1-ef9caca2088a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:29:56.919233 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:56.919209 2517 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 10:29:56.919278 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:56.919268 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert podName:41b34f49-8333-49eb-a1f1-ef9caca2088a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:58.91925411 +0000 UTC m=+58.669152721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-w54dt" (UID: "41b34f49-8333-49eb-a1f1-ef9caca2088a") : secret "networking-console-plugin-cert" not found Jul 29 10:29:58.830905 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:58.830870 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:58.830905 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:58.830914 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:29:58.831379 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:58.831021 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:29:58.831379 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:58.831059 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle podName:d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:02.83103322 +0000 UTC m=+62.580931855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle") pod "router-default-f8d744b6c-jpktk" (UID: "d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394") : configmap references non-existent config key: service-ca.crt Jul 29 10:29:58.831379 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:58.831091 2517 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 10:29:58.831379 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:58.831139 2517 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:58.831379 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:58.831156 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs podName:d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:02.831143084 +0000 UTC m=+62.581041717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs") pod "router-default-f8d744b6c-jpktk" (UID: "d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394") : secret "router-metrics-certs-default" not found Jul 29 10:29:58.831379 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:58.831227 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls podName:17d49008-e794-4257-bead-a90128ff8b2c nodeName:}" failed. No retries permitted until 2026-07-29 10:30:02.831209859 +0000 UTC m=+62.581108503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-86klv" (UID: "17d49008-e794-4257-bead-a90128ff8b2c") : secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:58.931293 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:29:58.931267 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-w54dt\" (UID: \"41b34f49-8333-49eb-a1f1-ef9caca2088a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:29:58.931432 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:58.931374 2517 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 10:29:58.931432 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:29:58.931416 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert podName:41b34f49-8333-49eb-a1f1-ef9caca2088a nodeName:}" failed. No retries permitted until 2026-07-29 10:30:02.931404324 +0000 UTC m=+62.681302935 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-w54dt" (UID: "41b34f49-8333-49eb-a1f1-ef9caca2088a") : secret "networking-console-plugin-cert" not found Jul 29 10:30:00.938712 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:00.938672 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g4l" Jul 29 10:30:01.991995 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:01.991956 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s87xx"] Jul 29 10:30:01.994618 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:01.994599 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:01.997260 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:01.997239 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 10:30:01.997380 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:01.997240 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 10:30:01.998004 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:01.997987 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 10:30:01.998990 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:01.998975 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-27qr7\"" Jul 29 10:30:02.000088 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.000072 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 10:30:02.016179 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.016160 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s87xx"] Jul 29 10:30:02.055075 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.055048 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sdxg\" (UniqueName: \"kubernetes.io/projected/600142b1-f705-415e-a041-0c46996966e4-kube-api-access-5sdxg\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.055222 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.055101 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/600142b1-f705-415e-a041-0c46996966e4-data-volume\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.055222 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.055137 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.055222 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.055154 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.055222 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.055211 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/600142b1-f705-415e-a041-0c46996966e4-crio-socket\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.155688 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.155653 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.155688 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.155687 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.155942 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.155765 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/600142b1-f705-415e-a041-0c46996966e4-crio-socket\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.155942 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.155792 2517 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:30:02.155942 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.155874 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm podName:600142b1-f705-415e-a041-0c46996966e4 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:02.655853206 +0000 UTC m=+62.405751834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s87xx" (UID: "600142b1-f705-415e-a041-0c46996966e4") : configmap "kube-rbac-proxy" not found Jul 29 10:30:02.155942 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.155879 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/600142b1-f705-415e-a041-0c46996966e4-crio-socket\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.155942 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.155892 2517 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:30:02.155942 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.155804 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sdxg\" (UniqueName: \"kubernetes.io/projected/600142b1-f705-415e-a041-0c46996966e4-kube-api-access-5sdxg\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.156164 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.155961 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls podName:600142b1-f705-415e-a041-0c46996966e4 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:02.655946612 +0000 UTC m=+62.405845224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s87xx" (UID: "600142b1-f705-415e-a041-0c46996966e4") : secret "insights-runtime-extractor-tls" not found Jul 29 10:30:02.156164 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.155983 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/600142b1-f705-415e-a041-0c46996966e4-data-volume\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.156279 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.156263 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/600142b1-f705-415e-a041-0c46996966e4-data-volume\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.169734 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.169691 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sdxg\" (UniqueName: \"kubernetes.io/projected/600142b1-f705-415e-a041-0c46996966e4-kube-api-access-5sdxg\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.660746 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.660710 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.660930 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.660758 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:02.660930 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.660771 2517 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:30:02.660930 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.660854 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm podName:600142b1-f705-415e-a041-0c46996966e4 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:03.660839148 +0000 UTC m=+63.410737760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s87xx" (UID: "600142b1-f705-415e-a041-0c46996966e4") : configmap "kube-rbac-proxy" not found Jul 29 10:30:02.660930 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.660905 2517 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:30:02.661083 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.660979 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls podName:600142b1-f705-415e-a041-0c46996966e4 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:03.660952595 +0000 UTC m=+63.410851220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s87xx" (UID: "600142b1-f705-415e-a041-0c46996966e4") : secret "insights-runtime-extractor-tls" not found Jul 29 10:30:02.863074 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.863029 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:30:02.863251 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.863102 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:30:02.863251 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.863119 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:30:02.863251 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.863189 2517 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 10:30:02.863251 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.863218 2517 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 10:30:02.863396 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.863253 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle podName:d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:10.863237397 +0000 UTC m=+70.613136008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle") pod "router-default-f8d744b6c-jpktk" (UID: "d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394") : configmap references non-existent config key: service-ca.crt Jul 29 10:30:02.863396 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.863274 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs podName:d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:10.863267403 +0000 UTC m=+70.613166016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs") pod "router-default-f8d744b6c-jpktk" (UID: "d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394") : secret "router-metrics-certs-default" not found Jul 29 10:30:02.863396 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.863283 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls podName:17d49008-e794-4257-bead-a90128ff8b2c nodeName:}" failed. No retries permitted until 2026-07-29 10:30:10.863278299 +0000 UTC m=+70.613176910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-86klv" (UID: "17d49008-e794-4257-bead-a90128ff8b2c") : secret "cluster-monitoring-operator-tls" not found Jul 29 10:30:02.964118 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:02.964087 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-w54dt\" (UID: \"41b34f49-8333-49eb-a1f1-ef9caca2088a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:30:02.964268 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.964232 2517 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 10:30:02.964311 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:02.964296 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert podName:41b34f49-8333-49eb-a1f1-ef9caca2088a nodeName:}" failed. No retries permitted until 2026-07-29 10:30:10.964280836 +0000 UTC m=+70.714179447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-w54dt" (UID: "41b34f49-8333-49eb-a1f1-ef9caca2088a") : secret "networking-console-plugin-cert" not found Jul 29 10:30:03.669884 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:03.669854 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:03.669884 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:03.669886 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:03.670338 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:03.669975 2517 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:30:03.670338 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:03.670034 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm podName:600142b1-f705-415e-a041-0c46996966e4 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:05.670019953 +0000 UTC m=+65.419918565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s87xx" (UID: "600142b1-f705-415e-a041-0c46996966e4") : configmap "kube-rbac-proxy" not found Jul 29 10:30:03.670338 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:03.670093 2517 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:30:03.670338 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:03.670162 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls podName:600142b1-f705-415e-a041-0c46996966e4 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:05.670145719 +0000 UTC m=+65.420044349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s87xx" (UID: "600142b1-f705-415e-a041-0c46996966e4") : secret "insights-runtime-extractor-tls" not found Jul 29 10:30:04.560467 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:04.560437 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7rkjp_73554e56-a2c1-4012-b7af-425b2f86ba7c/dns-node-resolver/0.log" Jul 29 10:30:05.685240 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:05.685201 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:05.685240 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:05.685236 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:05.685672 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:05.685314 2517 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:30:05.685672 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:05.685327 2517 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:30:05.685672 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:05.685374 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls podName:600142b1-f705-415e-a041-0c46996966e4 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:09.685360769 +0000 UTC m=+69.435259381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s87xx" (UID: "600142b1-f705-415e-a041-0c46996966e4") : secret "insights-runtime-extractor-tls" not found Jul 29 10:30:05.685672 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:05.685388 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm podName:600142b1-f705-415e-a041-0c46996966e4 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:09.685381753 +0000 UTC m=+69.435280365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s87xx" (UID: "600142b1-f705-415e-a041-0c46996966e4") : configmap "kube-rbac-proxy" not found Jul 29 10:30:05.960969 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:05.960944 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-shzv5_098abb85-fffa-4b88-a3c4-965f8b699caf/node-ca/0.log" Jul 29 10:30:06.391105 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.391002 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:30:06.391105 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.391100 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:30:06.393369 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.393346 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 10:30:06.393453 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.393345 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 10:30:06.401987 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:06.401965 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 10:30:06.402062 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:06.402048 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs podName:3b2b8b47-f121-4b15-8595-7152e2d10091 nodeName:}" failed. No retries permitted until 2026-07-29 10:31:10.402026734 +0000 UTC m=+130.151925361 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs") pod "network-metrics-daemon-hpzsh" (UID: "3b2b8b47-f121-4b15-8595-7152e2d10091") : secret "metrics-daemon-secret" not found Jul 29 10:30:06.403989 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.403971 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c606e9e5-8010-44dc-9a0e-8d4656eb495a-original-pull-secret\") pod \"global-pull-secret-syncer-72csv\" (UID: \"c606e9e5-8010-44dc-9a0e-8d4656eb495a\") " pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:30:06.593035 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.592993 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfgv\" (UniqueName: \"kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv\") pod \"network-check-target-mrgw4\" (UID: \"e7963bf2-2e04-413b-b2f7-38f3bf858b53\") " pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:30:06.596800 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.596774 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 10:30:06.604906 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.604878 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 10:30:06.615629 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.615599 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwfgv\" (UniqueName: \"kubernetes.io/projected/e7963bf2-2e04-413b-b2f7-38f3bf858b53-kube-api-access-hwfgv\") pod \"network-check-target-mrgw4\" (UID: \"e7963bf2-2e04-413b-b2f7-38f3bf858b53\") " pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:30:06.677421 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.677349 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72csv" Jul 29 10:30:06.687870 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.687848 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2mpdj\"" Jul 29 10:30:06.694685 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.694660 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:30:06.762382 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.762348 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v6wqm_8ef268b1-5b59-4dae-950b-8695dd350841/serve-healthcheck-canary/0.log" Jul 29 10:30:06.830861 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.830829 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-72csv"] Jul 29 10:30:06.835057 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:06.835030 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc606e9e5_8010_44dc_9a0e_8d4656eb495a.slice/crio-3df5c07da3c5255d82a5f38c4b745743efde8eb3bb8c1d2546bd164e89e6a9a3 WatchSource:0}: Error finding container 3df5c07da3c5255d82a5f38c4b745743efde8eb3bb8c1d2546bd164e89e6a9a3: Status 404 returned error can't find the container with id 3df5c07da3c5255d82a5f38c4b745743efde8eb3bb8c1d2546bd164e89e6a9a3 Jul 29 10:30:06.849178 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.849155 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mrgw4"] Jul 29 10:30:06.851676 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:06.851655 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7963bf2_2e04_413b_b2f7_38f3bf858b53.slice/crio-10fde7c5d14a8231fd6987a565130f3364b122bbace7df1ec4db44c89e7ede44 WatchSource:0}: Error finding container 10fde7c5d14a8231fd6987a565130f3364b122bbace7df1ec4db44c89e7ede44: Status 404 returned error can't find the container with id 10fde7c5d14a8231fd6987a565130f3364b122bbace7df1ec4db44c89e7ede44 Jul 29 10:30:06.898533 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.898492 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:30:06.901010 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:06.900991 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3a8551b-8b94-462f-acc1-09f58220aa32-metrics-tls\") pod \"dns-default-8vq7d\" (UID: \"c3a8551b-8b94-462f-acc1-09f58220aa32\") " pod="openshift-dns/dns-default-8vq7d" Jul 29 10:30:07.021849 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:07.021813 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-72csv" event={"ID":"c606e9e5-8010-44dc-9a0e-8d4656eb495a","Type":"ContainerStarted","Data":"3df5c07da3c5255d82a5f38c4b745743efde8eb3bb8c1d2546bd164e89e6a9a3"} Jul 29 10:30:07.022809 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:07.022789 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mrgw4" event={"ID":"e7963bf2-2e04-413b-b2f7-38f3bf858b53","Type":"ContainerStarted","Data":"10fde7c5d14a8231fd6987a565130f3364b122bbace7df1ec4db44c89e7ede44"} Jul 29 10:30:07.198010 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:07.197986 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hm7tz\"" Jul 29 10:30:07.206678 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:07.206656 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vq7d" Jul 29 10:30:07.351252 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:07.351221 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vq7d"] Jul 29 10:30:07.364846 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:07.364813 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a8551b_8b94_462f_acc1_09f58220aa32.slice/crio-aad155081b1dc78b4423a358df29d6dd173f192608aa239e07b9db10206a1211 WatchSource:0}: Error finding container aad155081b1dc78b4423a358df29d6dd173f192608aa239e07b9db10206a1211: Status 404 returned error can't find the container with id aad155081b1dc78b4423a358df29d6dd173f192608aa239e07b9db10206a1211 Jul 29 10:30:08.028608 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:08.028529 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vq7d" event={"ID":"c3a8551b-8b94-462f-acc1-09f58220aa32","Type":"ContainerStarted","Data":"aad155081b1dc78b4423a358df29d6dd173f192608aa239e07b9db10206a1211"} Jul 29 10:30:09.724511 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:09.724473 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:09.724511 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:09.724515 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:09.724993 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:09.724610 2517 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:30:09.724993 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:09.724633 2517 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:30:09.724993 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:09.724677 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls podName:600142b1-f705-415e-a041-0c46996966e4 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:17.724660415 +0000 UTC m=+77.474559028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s87xx" (UID: "600142b1-f705-415e-a041-0c46996966e4") : secret "insights-runtime-extractor-tls" not found Jul 29 10:30:09.724993 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:09.724694 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm podName:600142b1-f705-415e-a041-0c46996966e4 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:17.72468504 +0000 UTC m=+77.474583653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s87xx" (UID: "600142b1-f705-415e-a041-0c46996966e4") : configmap "kube-rbac-proxy" not found Jul 29 10:30:10.935437 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:10.935390 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:30:10.935891 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:10.935446 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:30:10.935891 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:10.935538 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:30:10.936150 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:10.936124 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-service-ca-bundle\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:30:10.938177 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:10.938149 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394-metrics-certs\") pod \"router-default-f8d744b6c-jpktk\" (UID: \"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394\") " pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:30:10.938323 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:10.938301 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17d49008-e794-4257-bead-a90128ff8b2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-86klv\" (UID: \"17d49008-e794-4257-bead-a90128ff8b2c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:30:11.011349 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:11.011312 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-74pst\"" Jul 29 10:30:11.015717 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:11.015682 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vrsl4\"" Jul 29 10:30:11.020244 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:11.020217 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" Jul 29 10:30:11.024768 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:11.024743 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:30:11.035885 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:11.035857 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-w54dt\" (UID: \"41b34f49-8333-49eb-a1f1-ef9caca2088a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:30:11.038405 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:11.038381 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41b34f49-8333-49eb-a1f1-ef9caca2088a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-w54dt\" (UID: \"41b34f49-8333-49eb-a1f1-ef9caca2088a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:30:11.089319 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:11.089289 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9qlwr\"" Jul 29 10:30:11.097963 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:11.097939 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" Jul 29 10:30:12.004817 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:12.004250 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-w54dt"] Jul 29 10:30:12.005680 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:12.005656 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv"] Jul 29 10:30:12.031864 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:12.031797 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f8d744b6c-jpktk"] Jul 29 10:30:12.037970 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:12.037925 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f32a8b_9dcb_4a91_86e2_ee8f1f0fb394.slice/crio-444bca90e37aa0f2afc432f3b4b214d3bf30ff7f59e948e71c80e2848046c2eb WatchSource:0}: Error finding container 444bca90e37aa0f2afc432f3b4b214d3bf30ff7f59e948e71c80e2848046c2eb: Status 404 returned error can't find the container with id 444bca90e37aa0f2afc432f3b4b214d3bf30ff7f59e948e71c80e2848046c2eb Jul 29 10:30:12.042472 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:12.042432 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-72csv" event={"ID":"c606e9e5-8010-44dc-9a0e-8d4656eb495a","Type":"ContainerStarted","Data":"f1b8e9321cf87dfa5978168274034a60a9576b328e9bff8600a74cac308b7d4a"} Jul 29 10:30:12.046983 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:12.046962 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mrgw4" event={"ID":"e7963bf2-2e04-413b-b2f7-38f3bf858b53","Type":"ContainerStarted","Data":"37c25b86711899d382c0aaf14ee9bb5b0ec26d8cc88d36af3a7d3195fa411c08"} Jul 29 10:30:12.047119 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:12.047093 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:30:12.048177 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:12.048151 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" event={"ID":"17d49008-e794-4257-bead-a90128ff8b2c","Type":"ContainerStarted","Data":"c3386d2025d1a22574c69b7c07c5fda9d705eb0a9bee75578558670757aa812c"} Jul 29 10:30:12.050590 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:12.050525 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vq7d" event={"ID":"c3a8551b-8b94-462f-acc1-09f58220aa32","Type":"ContainerStarted","Data":"10978ee15961a587e851b33603b8b544bff81aeec278a95f571cf0c73c4db905"} Jul 29 10:30:12.053289 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:12.053248 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" event={"ID":"41b34f49-8333-49eb-a1f1-ef9caca2088a","Type":"ContainerStarted","Data":"93e007ecc7c1e832ba66e7f63422e80e618b801f4e4aeb3d437bd22f05a3de80"} Jul 29 10:30:12.067313 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:12.066581 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-72csv" podStartSLOduration=67.070225686 podStartE2EDuration="1m12.066563451s" totalImagesPullingTime="4.996337765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:12.063168647 +0000 UTC m=+71.813067281" watchObservedRunningTime="2026-07-29 10:30:12.066563451 +0000 UTC m=+71.816462105" Jul 29 10:30:12.082048 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:12.082011 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mrgw4" podStartSLOduration=67.106944617 podStartE2EDuration="1m12.081997348s" totalImagesPullingTime="4.975052731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:12.080875819 +0000 UTC m=+71.830774468" watchObservedRunningTime="2026-07-29 10:30:12.081997348 +0000 UTC m=+71.831895981" Jul 29 10:30:13.060208 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:13.060167 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vq7d" event={"ID":"c3a8551b-8b94-462f-acc1-09f58220aa32","Type":"ContainerStarted","Data":"dd13eeb462e9d66fd69c52313e8aa09389dc2a558ea61a8dfc478511312ee18e"} Jul 29 10:30:13.060655 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:13.060323 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8vq7d" Jul 29 10:30:13.061905 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:13.061870 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" event={"ID":"41b34f49-8333-49eb-a1f1-ef9caca2088a","Type":"ContainerStarted","Data":"13e5673782a24ab3aca49e1e0ba9b849bc60cf18d8ce3569dfbdde87e5cc6392"} Jul 29 10:30:13.063805 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:13.063778 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f8d744b6c-jpktk" event={"ID":"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394","Type":"ContainerStarted","Data":"4cdbe1c4f6287c17107e32351684c6e41882e2d7789b28cd4bdff663cb56f732"} Jul 29 10:30:13.063901 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:13.063831 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f8d744b6c-jpktk" event={"ID":"d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394","Type":"ContainerStarted","Data":"444bca90e37aa0f2afc432f3b4b214d3bf30ff7f59e948e71c80e2848046c2eb"} Jul 29 10:30:13.080536 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:13.080489 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8vq7d" podStartSLOduration=33.621596885 podStartE2EDuration="38.080477315s" totalImagesPullingTime="4.45888043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:13.080047977 +0000 UTC m=+72.829946611" watchObservedRunningTime="2026-07-29 10:30:13.080477315 +0000 UTC m=+72.830375948" Jul 29 10:30:13.100565 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:13.100502 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-f8d744b6c-jpktk" podStartSLOduration=18.100485705 podStartE2EDuration="18.100485705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:13.100271402 +0000 UTC m=+72.850170091" watchObservedRunningTime="2026-07-29 10:30:13.100485705 +0000 UTC m=+72.850384319" Jul 29 10:30:13.116193 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:13.116152 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-w54dt" podStartSLOduration=17.210626461 podStartE2EDuration="18.116135916s" totalImagesPullingTime="905.509455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:13.114601629 +0000 UTC m=+72.864500268" watchObservedRunningTime="2026-07-29 10:30:13.116135916 +0000 UTC m=+72.866034551" Jul 29 10:30:14.025425 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:14.025391 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:30:14.027845 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:14.027822 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:30:14.069196 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:14.069149 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" event={"ID":"17d49008-e794-4257-bead-a90128ff8b2c","Type":"ContainerStarted","Data":"f55e12addf1badefb3d2c3884e358a43565ad5229d6f64d23679bbb01004c874"} Jul 29 10:30:14.069672 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:14.069652 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:30:14.070559 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:14.070539 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-f8d744b6c-jpktk" Jul 29 10:30:14.085301 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:14.085258 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-86klv" podStartSLOduration=17.61679661 podStartE2EDuration="19.085244215s" totalImagesPullingTime="1.468447605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:14.084321775 +0000 UTC m=+73.834220409" watchObservedRunningTime="2026-07-29 10:30:14.085244215 +0000 UTC m=+73.835142848" Jul 29 10:30:17.788242 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:17.788188 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:17.788242 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:17.788243 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:17.788734 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:17.788690 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/600142b1-f705-415e-a041-0c46996966e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:17.790462 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:17.790435 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/600142b1-f705-415e-a041-0c46996966e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s87xx\" (UID: \"600142b1-f705-415e-a041-0c46996966e4\") " pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:17.903294 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:17.903257 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s87xx" Jul 29 10:30:18.030285 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:18.030252 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s87xx"] Jul 29 10:30:18.033430 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:18.033405 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600142b1_f705_415e_a041_0c46996966e4.slice/crio-160adef495c71b73a9c89802f749e011e2dbbbc12999231ea0a24f21b635ad72 WatchSource:0}: Error finding container 160adef495c71b73a9c89802f749e011e2dbbbc12999231ea0a24f21b635ad72: Status 404 returned error can't find the container with id 160adef495c71b73a9c89802f749e011e2dbbbc12999231ea0a24f21b635ad72 Jul 29 10:30:18.083540 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:18.083474 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s87xx" event={"ID":"600142b1-f705-415e-a041-0c46996966e4","Type":"ContainerStarted","Data":"160adef495c71b73a9c89802f749e011e2dbbbc12999231ea0a24f21b635ad72"} Jul 29 10:30:23.072258 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.072179 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8vq7d" Jul 29 10:30:23.101329 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.101298 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s87xx" event={"ID":"600142b1-f705-415e-a041-0c46996966e4","Type":"ContainerStarted","Data":"d21822104487c7145f73c7b0689059bcf0994b075f54d4feba7f1f22b398db91"} Jul 29 10:30:23.253403 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.253373 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7"] Jul 29 10:30:23.256474 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.256425 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7" Jul 29 10:30:23.258788 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.258758 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 10:30:23.259045 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.259027 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 10:30:23.259129 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.259092 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 29 10:30:23.259346 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.259327 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-br4kk\"" Jul 29 10:30:23.260622 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.260600 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 10:30:23.282594 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.282569 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7"] Jul 29 10:30:23.331852 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.331765 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dszb\" (UniqueName: \"kubernetes.io/projected/5bbc77b1-0154-40b6-a9c3-c2db24688f33-kube-api-access-2dszb\") pod \"managed-serviceaccount-addon-agent-675f76745b-b5xg7\" (UID: \"5bbc77b1-0154-40b6-a9c3-c2db24688f33\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7" Jul 29 10:30:23.331852 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.331815 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5bbc77b1-0154-40b6-a9c3-c2db24688f33-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-675f76745b-b5xg7\" (UID: \"5bbc77b1-0154-40b6-a9c3-c2db24688f33\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7" Jul 29 10:30:23.361507 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.361471 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj"] Jul 29 10:30:23.364604 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.364572 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c6f9995c-692q7"] Jul 29 10:30:23.364740 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.364719 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj" Jul 29 10:30:23.366656 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.366636 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 10:30:23.366778 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.366657 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vklbq\"" Jul 29 10:30:23.369693 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.368920 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.372064 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.371500 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nkcld\"" Jul 29 10:30:23.372064 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.371643 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 10:30:23.372064 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.371760 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 10:30:23.372064 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.371927 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 10:30:23.372064 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.371952 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 10:30:23.372064 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.372023 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 10:30:23.372406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.372238 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 10:30:23.372406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.372286 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 10:30:23.383736 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.379959 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj"] Jul 29 10:30:23.384986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.384969 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6f9995c-692q7"] Jul 29 10:30:23.423355 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.423313 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54f49b87dc-wzxbl"] Jul 29 10:30:23.426481 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.426463 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.429411 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.429258 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 10:30:23.429411 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.429308 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 10:30:23.429411 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.429356 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 10:30:23.429912 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.429893 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c2kld\"" Jul 29 10:30:23.432164 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.432138 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8xr8\" (UniqueName: \"kubernetes.io/projected/73b66f65-719e-485b-9b73-733a2bd4a349-kube-api-access-h8xr8\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.432258 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.432196 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-oauth-config\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.432313 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.432253 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-service-ca\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.432313 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.432305 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-oauth-serving-cert\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.432428 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.432378 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c6692f4d-a4f4-4f9b-a6ac-e34936567391-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-67glj\" (UID: \"c6692f4d-a4f4-4f9b-a6ac-e34936567391\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj" Jul 29 10:30:23.432488 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.432422 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dszb\" (UniqueName: \"kubernetes.io/projected/5bbc77b1-0154-40b6-a9c3-c2db24688f33-kube-api-access-2dszb\") pod \"managed-serviceaccount-addon-agent-675f76745b-b5xg7\" (UID: \"5bbc77b1-0154-40b6-a9c3-c2db24688f33\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7" Jul 29 10:30:23.432488 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.432468 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-serving-cert\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.432586 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.432501 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5bbc77b1-0154-40b6-a9c3-c2db24688f33-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-675f76745b-b5xg7\" (UID: \"5bbc77b1-0154-40b6-a9c3-c2db24688f33\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7" Jul 29 10:30:23.432586 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.432565 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-console-config\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.437907 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.435923 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 10:30:23.437907 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.435939 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5bbc77b1-0154-40b6-a9c3-c2db24688f33-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-675f76745b-b5xg7\" (UID: \"5bbc77b1-0154-40b6-a9c3-c2db24688f33\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7" Jul 29 10:30:23.448130 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.448100 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54f49b87dc-wzxbl"] Jul 29 10:30:23.457329 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.457300 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dszb\" (UniqueName: \"kubernetes.io/projected/5bbc77b1-0154-40b6-a9c3-c2db24688f33-kube-api-access-2dszb\") pod \"managed-serviceaccount-addon-agent-675f76745b-b5xg7\" (UID: \"5bbc77b1-0154-40b6-a9c3-c2db24688f33\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7" Jul 29 10:30:23.533416 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533377 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgmfb\" (UniqueName: \"kubernetes.io/projected/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-kube-api-access-xgmfb\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.533543 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533426 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-oauth-serving-cert\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.533543 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533485 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-registry-tls\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.533543 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533519 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-trusted-ca\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.533733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533546 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-ca-trust-extracted\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.533733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533574 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-bound-sa-token\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.533733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533604 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c6692f4d-a4f4-4f9b-a6ac-e34936567391-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-67glj\" (UID: \"c6692f4d-a4f4-4f9b-a6ac-e34936567391\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj" Jul 29 10:30:23.533733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533636 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-serving-cert\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.533733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533690 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-image-registry-private-configuration\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.533733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533730 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-registry-certificates\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.534038 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533761 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-console-config\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.534038 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533791 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8xr8\" (UniqueName: \"kubernetes.io/projected/73b66f65-719e-485b-9b73-733a2bd4a349-kube-api-access-h8xr8\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.534038 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533815 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-installation-pull-secrets\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.534038 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533851 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-oauth-config\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.534038 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.533880 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-service-ca\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.535259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.534596 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-service-ca\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.535259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.535050 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-console-config\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.535259 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.535224 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-oauth-serving-cert\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.537494 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.537451 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c6692f4d-a4f4-4f9b-a6ac-e34936567391-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-67glj\" (UID: \"c6692f4d-a4f4-4f9b-a6ac-e34936567391\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj" Jul 29 10:30:23.537604 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.537571 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-oauth-config\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.539559 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.539538 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-serving-cert\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.543193 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.543149 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8xr8\" (UniqueName: \"kubernetes.io/projected/73b66f65-719e-485b-9b73-733a2bd4a349-kube-api-access-h8xr8\") pod \"console-6c6f9995c-692q7\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.581914 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.581852 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7" Jul 29 10:30:23.634464 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.634390 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgmfb\" (UniqueName: \"kubernetes.io/projected/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-kube-api-access-xgmfb\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.634464 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.634459 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-registry-tls\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.634679 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.634498 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-trusted-ca\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.634679 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.634525 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-ca-trust-extracted\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.634679 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.634549 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-bound-sa-token\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.634679 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.634613 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-image-registry-private-configuration\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.634679 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.634645 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-registry-certificates\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.634954 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.634684 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-installation-pull-secrets\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.635620 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.635311 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-ca-trust-extracted\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.635909 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.635879 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-trusted-ca\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.636327 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.636296 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-registry-certificates\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.637451 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.637410 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-registry-tls\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.637651 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.637586 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-installation-pull-secrets\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.638052 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.638030 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-image-registry-private-configuration\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.649453 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.649403 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-bound-sa-token\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.661064 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.661017 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgmfb\" (UniqueName: \"kubernetes.io/projected/7f2933ca-2f84-4e11-a89e-1a2af191b1e4-kube-api-access-xgmfb\") pod \"image-registry-54f49b87dc-wzxbl\" (UID: \"7f2933ca-2f84-4e11-a89e-1a2af191b1e4\") " pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.677507 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.677484 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj" Jul 29 10:30:23.688096 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.688069 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:23.738064 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.738029 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7"] Jul 29 10:30:23.744967 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.744774 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:23.745834 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:23.745801 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bbc77b1_0154_40b6_a9c3_c2db24688f33.slice/crio-071e7390d4cbe65531ebcdbb8d2873dc59aee4de145d123ba5f105be05d62aed WatchSource:0}: Error finding container 071e7390d4cbe65531ebcdbb8d2873dc59aee4de145d123ba5f105be05d62aed: Status 404 returned error can't find the container with id 071e7390d4cbe65531ebcdbb8d2873dc59aee4de145d123ba5f105be05d62aed Jul 29 10:30:23.845427 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.845361 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj"] Jul 29 10:30:23.849808 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:23.849774 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6692f4d_a4f4_4f9b_a6ac_e34936567391.slice/crio-34e71c75fa6797339a0692c1dd68d78a42d0b2f1a67d33deb5d3df8ce872b221 WatchSource:0}: Error finding container 34e71c75fa6797339a0692c1dd68d78a42d0b2f1a67d33deb5d3df8ce872b221: Status 404 returned error can't find the container with id 34e71c75fa6797339a0692c1dd68d78a42d0b2f1a67d33deb5d3df8ce872b221 Jul 29 10:30:23.868804 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.868737 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6f9995c-692q7"] Jul 29 10:30:23.873373 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:23.873319 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b66f65_719e_485b_9b73_733a2bd4a349.slice/crio-031faf17a22823a50f9c9bc6f0d41564e7f205bdee9ce4482f4701c04367b407 WatchSource:0}: Error finding container 031faf17a22823a50f9c9bc6f0d41564e7f205bdee9ce4482f4701c04367b407: Status 404 returned error can't find the container with id 031faf17a22823a50f9c9bc6f0d41564e7f205bdee9ce4482f4701c04367b407 Jul 29 10:30:23.915276 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:23.915247 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54f49b87dc-wzxbl"] Jul 29 10:30:23.918468 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:23.918438 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2933ca_2f84_4e11_a89e_1a2af191b1e4.slice/crio-18d7fc867ce3de1c2c81da2ec3c9b7fa813b49bfd91828ebe2c2dbf4d51d1efd WatchSource:0}: Error finding container 18d7fc867ce3de1c2c81da2ec3c9b7fa813b49bfd91828ebe2c2dbf4d51d1efd: Status 404 returned error can't find the container with id 18d7fc867ce3de1c2c81da2ec3c9b7fa813b49bfd91828ebe2c2dbf4d51d1efd Jul 29 10:30:24.106622 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:24.106538 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj" event={"ID":"c6692f4d-a4f4-4f9b-a6ac-e34936567391","Type":"ContainerStarted","Data":"34e71c75fa6797339a0692c1dd68d78a42d0b2f1a67d33deb5d3df8ce872b221"} Jul 29 10:30:24.107999 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:24.107956 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7" event={"ID":"5bbc77b1-0154-40b6-a9c3-c2db24688f33","Type":"ContainerStarted","Data":"071e7390d4cbe65531ebcdbb8d2873dc59aee4de145d123ba5f105be05d62aed"} Jul 29 10:30:24.109761 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:24.109733 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" event={"ID":"7f2933ca-2f84-4e11-a89e-1a2af191b1e4","Type":"ContainerStarted","Data":"a1180c2a8df8905c45ea59511fa3d816e8b1fce7aaa69781be0b5e9e0e98170a"} Jul 29 10:30:24.109883 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:24.109784 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" event={"ID":"7f2933ca-2f84-4e11-a89e-1a2af191b1e4","Type":"ContainerStarted","Data":"18d7fc867ce3de1c2c81da2ec3c9b7fa813b49bfd91828ebe2c2dbf4d51d1efd"} Jul 29 10:30:24.109883 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:24.109824 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:24.111129 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:24.111107 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6f9995c-692q7" event={"ID":"73b66f65-719e-485b-9b73-733a2bd4a349","Type":"ContainerStarted","Data":"031faf17a22823a50f9c9bc6f0d41564e7f205bdee9ce4482f4701c04367b407"} Jul 29 10:30:24.128366 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:24.128324 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" podStartSLOduration=1.128306333 podStartE2EDuration="1.128306333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:24.127360238 +0000 UTC m=+83.877258874" watchObservedRunningTime="2026-07-29 10:30:24.128306333 +0000 UTC m=+83.878204967" Jul 29 10:30:29.136465 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:29.136427 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s87xx" event={"ID":"600142b1-f705-415e-a041-0c46996966e4","Type":"ContainerStarted","Data":"df5ca57d0d432eea184ef7e85761ffab4ca4e0e375b63bd01e845243f37a8e53"} Jul 29 10:30:29.138179 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:29.138149 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj" event={"ID":"c6692f4d-a4f4-4f9b-a6ac-e34936567391","Type":"ContainerStarted","Data":"e958737470051456ed64ec78626a25e227574d57670f1fd9d5b735141dcedd0a"} Jul 29 10:30:29.138487 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:29.138445 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj" Jul 29 10:30:29.139949 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:29.139907 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7" event={"ID":"5bbc77b1-0154-40b6-a9c3-c2db24688f33","Type":"ContainerStarted","Data":"dca7ade59e8d261d4427620de541f3021c8ef6e99a04b8583f5b16e86c365953"} Jul 29 10:30:29.143828 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:29.143807 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj" Jul 29 10:30:29.155569 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:29.155515 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-67glj" podStartSLOduration=1.90654448 podStartE2EDuration="6.155499932s" totalImagesPullingTime="4.248955452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:29.154372212 +0000 UTC m=+88.904270846" watchObservedRunningTime="2026-07-29 10:30:29.155499932 +0000 UTC m=+88.905398543" Jul 29 10:30:29.183493 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:29.183422 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-675f76745b-b5xg7" podStartSLOduration=1.8747485419999999 podStartE2EDuration="6.183403109s" totalImagesPullingTime="4.308654567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:29.183023633 +0000 UTC m=+88.932922268" watchObservedRunningTime="2026-07-29 10:30:29.183403109 +0000 UTC m=+88.933301744" Jul 29 10:30:30.146329 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:30.146052 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6f9995c-692q7" event={"ID":"73b66f65-719e-485b-9b73-733a2bd4a349","Type":"ContainerStarted","Data":"2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb"} Jul 29 10:30:30.166937 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:30.166885 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c6f9995c-692q7" podStartSLOduration=1.802708891 podStartE2EDuration="7.166863939s" totalImagesPullingTime="5.364155048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:30.165611477 +0000 UTC m=+89.915510114" watchObservedRunningTime="2026-07-29 10:30:30.166863939 +0000 UTC m=+89.916762572" Jul 29 10:30:33.159712 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:33.159662 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s87xx" event={"ID":"600142b1-f705-415e-a041-0c46996966e4","Type":"ContainerStarted","Data":"0a54038aa23e0a41dcaa355bf0e0a5db7a3e7daaf67185ac49e44323d3ee7f3d"} Jul 29 10:30:33.178032 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:33.177986 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s87xx" podStartSLOduration=18.068025129 podStartE2EDuration="32.177972402s" totalImagesPullingTime="14.109947273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:30:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:33.176430187 +0000 UTC m=+92.926328824" watchObservedRunningTime="2026-07-29 10:30:33.177972402 +0000 UTC m=+92.927871036" Jul 29 10:30:33.688916 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:33.688888 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:33.689089 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:33.688942 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:33.693088 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:33.693063 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:34.166343 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:34.166311 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:30:36.419614 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.419579 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt"] Jul 29 10:30:36.507966 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.507941 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v"] Jul 29 10:30:36.508116 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.508073 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.510170 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.510146 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 10:30:36.510301 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.510186 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sw262\"" Jul 29 10:30:36.510301 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.510208 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 10:30:36.510429 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.510413 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 10:30:36.527184 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.527158 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt"] Jul 29 10:30:36.527282 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.527195 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mfd2c"] Jul 29 10:30:36.527282 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.527270 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.529033 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.529016 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 29 10:30:36.529498 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.529478 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jcmdl\"" Jul 29 10:30:36.529591 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.529577 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 29 10:30:36.529735 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.529714 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 29 10:30:36.547480 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.547462 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v"] Jul 29 10:30:36.547564 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.547554 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.549266 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.549252 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-22g7n\"" Jul 29 10:30:36.549529 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.549511 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 10:30:36.549635 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.549620 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 10:30:36.549766 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.549664 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 10:30:36.645363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645338 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-wtmp\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.645558 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645381 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.645558 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645477 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.645558 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645519 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.645558 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645545 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxc42\" (UniqueName: \"kubernetes.io/projected/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-api-access-fxc42\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.645892 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645568 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91ffc8ca-36a5-41a3-886f-735aff042078-root\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.645892 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645594 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-tls\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.645892 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645621 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91ffc8ca-36a5-41a3-886f-735aff042078-metrics-client-ca\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.645892 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645671 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/927d047f-2a6d-4743-83a9-9e3142a9e221-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.645892 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645730 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-textfile\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.645892 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645753 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-accelerators-collector-config\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.645892 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645785 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.645892 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645809 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5mvf\" (UniqueName: \"kubernetes.io/projected/91ffc8ca-36a5-41a3-886f-735aff042078-kube-api-access-g5mvf\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.645892 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645859 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/927d047f-2a6d-4743-83a9-9e3142a9e221-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.646332 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645947 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91ffc8ca-36a5-41a3-886f-735aff042078-sys\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.646332 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645974 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffl2w\" (UniqueName: \"kubernetes.io/projected/927d047f-2a6d-4743-83a9-9e3142a9e221-kube-api-access-ffl2w\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.646332 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.645992 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.646332 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.646020 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.646332 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.646051 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/927d047f-2a6d-4743-83a9-9e3142a9e221-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.747052 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747027 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91ffc8ca-36a5-41a3-886f-735aff042078-sys\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.747190 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747058 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffl2w\" (UniqueName: \"kubernetes.io/projected/927d047f-2a6d-4743-83a9-9e3142a9e221-kube-api-access-ffl2w\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.747190 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747076 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.747190 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747101 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.747190 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747136 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91ffc8ca-36a5-41a3-886f-735aff042078-sys\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.747395 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747229 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/927d047f-2a6d-4743-83a9-9e3142a9e221-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.747395 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747291 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-wtmp\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.747395 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747331 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.747395 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:36.747352 2517 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 29 10:30:36.747651 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:36.747412 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/927d047f-2a6d-4743-83a9-9e3142a9e221-openshift-state-metrics-tls podName:927d047f-2a6d-4743-83a9-9e3142a9e221 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:37.24739771 +0000 UTC m=+96.997296322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/927d047f-2a6d-4743-83a9-9e3142a9e221-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-kjhzt" (UID: "927d047f-2a6d-4743-83a9-9e3142a9e221") : secret "openshift-state-metrics-tls" not found Jul 29 10:30:36.747651 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747468 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.747651 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747512 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.747651 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747474 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-wtmp\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.747651 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747639 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxc42\" (UniqueName: \"kubernetes.io/projected/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-api-access-fxc42\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.747934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747675 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91ffc8ca-36a5-41a3-886f-735aff042078-root\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.747934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747730 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-tls\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.747934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747761 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91ffc8ca-36a5-41a3-886f-735aff042078-metrics-client-ca\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.747934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747768 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.747934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747791 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/927d047f-2a6d-4743-83a9-9e3142a9e221-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.747934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747819 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.747934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747822 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-textfile\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.747934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747845 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91ffc8ca-36a5-41a3-886f-735aff042078-root\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.747934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747848 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-accelerators-collector-config\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.747934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747891 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.747934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747925 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mvf\" (UniqueName: \"kubernetes.io/projected/91ffc8ca-36a5-41a3-886f-735aff042078-kube-api-access-g5mvf\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.748487 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.747958 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/927d047f-2a6d-4743-83a9-9e3142a9e221-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.748487 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:36.748025 2517 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 29 10:30:36.748487 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:30:36.748093 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-tls podName:91ffc8ca-36a5-41a3-886f-735aff042078 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:37.248075006 +0000 UTC m=+96.997973622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-tls") pod "node-exporter-mfd2c" (UID: "91ffc8ca-36a5-41a3-886f-735aff042078") : secret "node-exporter-tls" not found Jul 29 10:30:36.748487 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.748380 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.748487 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.748395 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-accelerators-collector-config\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.748756 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.748613 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/927d047f-2a6d-4743-83a9-9e3142a9e221-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.748756 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.748666 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-textfile\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.748952 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.748926 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91ffc8ca-36a5-41a3-886f-735aff042078-metrics-client-ca\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.750085 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.750058 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.750222 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.750200 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/927d047f-2a6d-4743-83a9-9e3142a9e221-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.750354 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.750339 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.750729 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.750709 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.755226 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.755202 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxc42\" (UniqueName: \"kubernetes.io/projected/2d6bdb39-2ce4-428e-92f6-cf00d9002e04-kube-api-access-fxc42\") pod \"kube-state-metrics-56d9f944b4-hxf8v\" (UID: \"2d6bdb39-2ce4-428e-92f6-cf00d9002e04\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.755309 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.755238 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffl2w\" (UniqueName: \"kubernetes.io/projected/927d047f-2a6d-4743-83a9-9e3142a9e221-kube-api-access-ffl2w\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:36.755424 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.755406 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5mvf\" (UniqueName: \"kubernetes.io/projected/91ffc8ca-36a5-41a3-886f-735aff042078-kube-api-access-g5mvf\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:36.836103 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.836075 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" Jul 29 10:30:36.987651 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:36.987620 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v"] Jul 29 10:30:36.990357 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:36.990329 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6bdb39_2ce4_428e_92f6_cf00d9002e04.slice/crio-23223434224e1fea8097b9f9de4f439290c293558115b9ab16ec7b77f513cd02 WatchSource:0}: Error finding container 23223434224e1fea8097b9f9de4f439290c293558115b9ab16ec7b77f513cd02: Status 404 returned error can't find the container with id 23223434224e1fea8097b9f9de4f439290c293558115b9ab16ec7b77f513cd02 Jul 29 10:30:37.174223 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.174145 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" event={"ID":"2d6bdb39-2ce4-428e-92f6-cf00d9002e04","Type":"ContainerStarted","Data":"23223434224e1fea8097b9f9de4f439290c293558115b9ab16ec7b77f513cd02"} Jul 29 10:30:37.251932 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.251890 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/927d047f-2a6d-4743-83a9-9e3142a9e221-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:37.251932 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.251946 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-tls\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:37.254237 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.254214 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91ffc8ca-36a5-41a3-886f-735aff042078-node-exporter-tls\") pod \"node-exporter-mfd2c\" (UID: \"91ffc8ca-36a5-41a3-886f-735aff042078\") " pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:37.254334 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.254316 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/927d047f-2a6d-4743-83a9-9e3142a9e221-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kjhzt\" (UID: \"927d047f-2a6d-4743-83a9-9e3142a9e221\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:37.417180 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.417154 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" Jul 29 10:30:37.455462 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.455435 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mfd2c" Jul 29 10:30:37.498058 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:37.498034 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ffc8ca_36a5_41a3_886f_735aff042078.slice/crio-61d42e6d41e944efb83b7fb2cd1f70b7e31786e4d26e9a02e6f0f1d201fb1d9c WatchSource:0}: Error finding container 61d42e6d41e944efb83b7fb2cd1f70b7e31786e4d26e9a02e6f0f1d201fb1d9c: Status 404 returned error can't find the container with id 61d42e6d41e944efb83b7fb2cd1f70b7e31786e4d26e9a02e6f0f1d201fb1d9c Jul 29 10:30:37.537127 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.537102 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:30:37.545275 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.545247 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.547376 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.547355 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 10:30:37.547583 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.547420 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 10:30:37.547583 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.547427 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 10:30:37.547583 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.547494 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 10:30:37.547969 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.547851 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 10:30:37.547969 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.547865 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 10:30:37.547969 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.547902 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 10:30:37.548214 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.548135 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 10:30:37.548214 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.548169 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qfzmc\"" Jul 29 10:30:37.554784 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.554301 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 10:30:37.557825 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.557804 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:30:37.618806 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.618773 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt"] Jul 29 10:30:37.622175 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:37.622147 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927d047f_2a6d_4743_83a9_9e3142a9e221.slice/crio-747c1dfe8620809b343b44fb045706dda28101518cc64f663502dd5774ea8e5b WatchSource:0}: Error finding container 747c1dfe8620809b343b44fb045706dda28101518cc64f663502dd5774ea8e5b: Status 404 returned error can't find the container with id 747c1dfe8620809b343b44fb045706dda28101518cc64f663502dd5774ea8e5b Jul 29 10:30:37.655415 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655389 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655510 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655447 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-web-config\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655570 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655539 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655623 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655566 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655623 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655598 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655625 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655648 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng2ss\" (UniqueName: \"kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-kube-api-access-ng2ss\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655677 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655945 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655731 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-config-volume\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655945 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655818 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655945 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655845 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-config-out\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655945 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655873 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.655945 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.655899 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757187 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757155 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757294 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757203 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-config-out\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757294 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757231 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757294 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757258 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757294 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757287 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757476 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757335 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-web-config\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757476 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757366 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757476 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757389 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757476 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757419 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757476 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757447 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757476 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757472 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2ss\" (UniqueName: \"kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-kube-api-access-ng2ss\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757791 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757501 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.757791 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.757539 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-config-volume\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.760296 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.759149 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.760296 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.759572 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.760296 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.759966 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.763303 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.763275 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.763848 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.763542 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.763848 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.763673 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-web-config\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.763848 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.763814 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.763848 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.763828 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.764132 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.764105 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.764549 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.764502 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-config-volume\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.779210 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.769102 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.779210 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.772380 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-config-out\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.781621 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.781598 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng2ss\" (UniqueName: \"kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-kube-api-access-ng2ss\") pod \"alertmanager-main-0\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:37.858033 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:37.857960 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:30:38.041731 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:38.041581 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:30:38.179928 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:38.179889 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mfd2c" event={"ID":"91ffc8ca-36a5-41a3-886f-735aff042078","Type":"ContainerStarted","Data":"61d42e6d41e944efb83b7fb2cd1f70b7e31786e4d26e9a02e6f0f1d201fb1d9c"} Jul 29 10:30:38.182071 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:38.182043 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" event={"ID":"927d047f-2a6d-4743-83a9-9e3142a9e221","Type":"ContainerStarted","Data":"38fc8c58212e0bf350b9413a742ca0168d6280e258ad359fc28fdac61ef36d5a"} Jul 29 10:30:38.182205 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:38.182100 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" event={"ID":"927d047f-2a6d-4743-83a9-9e3142a9e221","Type":"ContainerStarted","Data":"df60702675171e4ce722ea0243d3cf3485ae2a77a89e8190a799f0fe3f9387fb"} Jul 29 10:30:38.182205 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:38.182130 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" event={"ID":"927d047f-2a6d-4743-83a9-9e3142a9e221","Type":"ContainerStarted","Data":"747c1dfe8620809b343b44fb045706dda28101518cc64f663502dd5774ea8e5b"} Jul 29 10:30:38.393313 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:38.393242 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ad7757_d6ed_4c38_a292_92b3debf5166.slice/crio-e93c27b09e08359d3d92c6f125aa42ac2a8d405c0cc33471e3104fd5acac12c5 WatchSource:0}: Error finding container e93c27b09e08359d3d92c6f125aa42ac2a8d405c0cc33471e3104fd5acac12c5: Status 404 returned error can't find the container with id e93c27b09e08359d3d92c6f125aa42ac2a8d405c0cc33471e3104fd5acac12c5 Jul 29 10:30:39.188891 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.188844 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" event={"ID":"2d6bdb39-2ce4-428e-92f6-cf00d9002e04","Type":"ContainerStarted","Data":"35f42bf67cd6bdcebbf396f5c8add880f3d775f1e098683970c7dbc6c6c6bdff"} Jul 29 10:30:39.189289 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.188927 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" event={"ID":"2d6bdb39-2ce4-428e-92f6-cf00d9002e04","Type":"ContainerStarted","Data":"2c75b3d2aacde78a6bd74f995022792dfa706918d97615917e7d70ec42d658e5"} Jul 29 10:30:39.190890 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.190544 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerStarted","Data":"e93c27b09e08359d3d92c6f125aa42ac2a8d405c0cc33471e3104fd5acac12c5"} Jul 29 10:30:39.426124 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.426095 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-9ffc76c4-gmmd2"] Jul 29 10:30:39.463649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.463622 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9ffc76c4-gmmd2"] Jul 29 10:30:39.463822 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.463752 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.465731 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.465690 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 10:30:39.465848 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.465691 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ae92cjtpf5osd\"" Jul 29 10:30:39.465848 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.465793 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hlf8j\"" Jul 29 10:30:39.465848 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.465806 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 10:30:39.466057 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.466041 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 10:30:39.466117 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.466094 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 10:30:39.466331 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.466307 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 10:30:39.575034 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.575006 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-grpc-tls\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.575135 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.575039 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.575135 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.575066 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.575135 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.575090 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.575135 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.575121 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbpkk\" (UniqueName: \"kubernetes.io/projected/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-kube-api-access-cbpkk\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.575270 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.575211 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-metrics-client-ca\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.575303 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.575265 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-tls\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.575378 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.575357 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.676244 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.676213 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.676365 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.676266 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-grpc-tls\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.676365 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.676299 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.676365 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.676322 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.676365 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.676361 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.676542 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.676409 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbpkk\" (UniqueName: \"kubernetes.io/projected/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-kube-api-access-cbpkk\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.676542 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.676452 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-metrics-client-ca\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.676542 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.676524 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-tls\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.677641 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.677615 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-metrics-client-ca\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.679371 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.679342 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.679477 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.679347 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.679545 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.679524 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.679633 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.679613 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.679724 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.679665 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-thanos-querier-tls\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.679813 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.679795 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-secret-grpc-tls\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.684716 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.684675 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbpkk\" (UniqueName: \"kubernetes.io/projected/47b31d24-8ec0-4cc0-8c92-d2596d9b49fc-kube-api-access-cbpkk\") pod \"thanos-querier-9ffc76c4-gmmd2\" (UID: \"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc\") " pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:39.773021 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:39.772940 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:40.475496 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:40.475414 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9ffc76c4-gmmd2"] Jul 29 10:30:40.480289 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:40.480257 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b31d24_8ec0_4cc0_8c92_d2596d9b49fc.slice/crio-2b8f9108521484fff87f7820feadf19553dae6de65a904f603afa5ffdb64fa20 WatchSource:0}: Error finding container 2b8f9108521484fff87f7820feadf19553dae6de65a904f603afa5ffdb64fa20: Status 404 returned error can't find the container with id 2b8f9108521484fff87f7820feadf19553dae6de65a904f603afa5ffdb64fa20 Jul 29 10:30:41.202319 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.202282 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" event={"ID":"2d6bdb39-2ce4-428e-92f6-cf00d9002e04","Type":"ContainerStarted","Data":"6b6ffd8384c758ccabd7809e738a54f71a39a47f68a38e2da128dad9ec5f1602"} Jul 29 10:30:41.204517 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.204477 2517 generic.go:356] "Generic (PLEG): container finished" podID="91ffc8ca-36a5-41a3-886f-735aff042078" containerID="68dbe3b97effcceaa42e0a1ee8b7d164b7e455cd9e3236ffe679df4ad4005d31" exitCode=0 Jul 29 10:30:41.204648 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.204623 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mfd2c" event={"ID":"91ffc8ca-36a5-41a3-886f-735aff042078","Type":"ContainerDied","Data":"68dbe3b97effcceaa42e0a1ee8b7d164b7e455cd9e3236ffe679df4ad4005d31"} Jul 29 10:30:41.207402 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.207372 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" event={"ID":"927d047f-2a6d-4743-83a9-9e3142a9e221","Type":"ContainerStarted","Data":"9ada451ea593b9962b7aa0a213fc6529b415ec322639f8642992faf505cee460"} Jul 29 10:30:41.209449 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.209423 2517 generic.go:356] "Generic (PLEG): container finished" podID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerID="a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c" exitCode=0 Jul 29 10:30:41.209557 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.209526 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerDied","Data":"a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c"} Jul 29 10:30:41.210938 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.210903 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" event={"ID":"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc","Type":"ContainerStarted","Data":"2b8f9108521484fff87f7820feadf19553dae6de65a904f603afa5ffdb64fa20"} Jul 29 10:30:41.223192 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.223143 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hxf8v" podStartSLOduration=3.618534802 podStartE2EDuration="5.223126607s" totalImagesPullingTime="1.604591805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:41.22256445 +0000 UTC m=+100.972463083" watchObservedRunningTime="2026-07-29 10:30:41.223126607 +0000 UTC m=+100.973025241" Jul 29 10:30:41.262568 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.262523 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjhzt" podStartSLOduration=2.823190958 podStartE2EDuration="5.26250778s" totalImagesPullingTime="2.439316822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:41.261564303 +0000 UTC m=+101.011462940" watchObservedRunningTime="2026-07-29 10:30:41.26250778 +0000 UTC m=+101.012406418" Jul 29 10:30:41.675830 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.675794 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-84f855f498-fjxnx"] Jul 29 10:30:41.701988 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.701958 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84f855f498-fjxnx"] Jul 29 10:30:41.702127 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.702070 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.703936 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.703908 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 10:30:41.704089 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.704018 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 10:30:41.704310 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.704293 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 10:30:41.704406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.704292 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 10:30:41.704406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.704347 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 10:30:41.704513 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.704434 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lgpv6\"" Jul 29 10:30:41.709047 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.709024 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 10:30:41.796230 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.796144 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-secret-telemeter-client\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.796230 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.796182 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/754389d2-e463-48b4-8149-6c87132c18cd-serving-certs-ca-bundle\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.796230 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.796204 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/754389d2-e463-48b4-8149-6c87132c18cd-metrics-client-ca\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.796502 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.796296 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/754389d2-e463-48b4-8149-6c87132c18cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.796502 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.796335 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.796502 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.796400 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-federate-client-tls\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.796502 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.796424 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-telemeter-client-tls\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.796502 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.796483 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqqls\" (UniqueName: \"kubernetes.io/projected/754389d2-e463-48b4-8149-6c87132c18cd-kube-api-access-kqqls\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.897648 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.897615 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/754389d2-e463-48b4-8149-6c87132c18cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.897832 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.897657 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.897832 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.897719 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-federate-client-tls\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.897832 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.897753 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-telemeter-client-tls\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.897832 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.897829 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqqls\" (UniqueName: \"kubernetes.io/projected/754389d2-e463-48b4-8149-6c87132c18cd-kube-api-access-kqqls\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.898033 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.897914 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-secret-telemeter-client\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.898033 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.897942 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/754389d2-e463-48b4-8149-6c87132c18cd-serving-certs-ca-bundle\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.898033 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.897966 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/754389d2-e463-48b4-8149-6c87132c18cd-metrics-client-ca\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.898629 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.898598 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/754389d2-e463-48b4-8149-6c87132c18cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.898864 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.898841 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/754389d2-e463-48b4-8149-6c87132c18cd-metrics-client-ca\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.899019 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.898991 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/754389d2-e463-48b4-8149-6c87132c18cd-serving-certs-ca-bundle\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.901030 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.901009 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-telemeter-client-tls\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.901189 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.901164 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-secret-telemeter-client\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.901272 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.901171 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-federate-client-tls\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.901335 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.901319 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/754389d2-e463-48b4-8149-6c87132c18cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:41.905669 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:41.905646 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqqls\" (UniqueName: \"kubernetes.io/projected/754389d2-e463-48b4-8149-6c87132c18cd-kube-api-access-kqqls\") pod \"telemeter-client-84f855f498-fjxnx\" (UID: \"754389d2-e463-48b4-8149-6c87132c18cd\") " pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:42.012711 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:42.012675 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" Jul 29 10:30:42.219255 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:42.219219 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mfd2c" event={"ID":"91ffc8ca-36a5-41a3-886f-735aff042078","Type":"ContainerStarted","Data":"df7ab675ec4d6f9af332e23f4f67b00213d39cb32513ddd819b5b72566d644e1"} Jul 29 10:30:42.219424 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:42.219281 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mfd2c" event={"ID":"91ffc8ca-36a5-41a3-886f-735aff042078","Type":"ContainerStarted","Data":"21781ba1b622f0be4be16842a62314359a8d8017a1d8651c6b3ca9567642a8b7"} Jul 29 10:30:42.239443 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:42.239378 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mfd2c" podStartSLOduration=3.324238214 podStartE2EDuration="6.239359488s" totalImagesPullingTime="2.827313409s" totalInitContainerRuntime="87.807865ms" isStatefulPod=true podCreationTimestamp="2026-07-29 10:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:42.23864283 +0000 UTC m=+101.988541510" watchObservedRunningTime="2026-07-29 10:30:42.239359488 +0000 UTC m=+101.989258114" Jul 29 10:30:42.472309 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:42.472280 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84f855f498-fjxnx"] Jul 29 10:30:42.476042 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:42.476017 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754389d2_e463_48b4_8149_6c87132c18cd.slice/crio-1b3b93c568bce748ab4630cd3f57c5040ae579d3575c450a04c4e2336bcd1c53 WatchSource:0}: Error finding container 1b3b93c568bce748ab4630cd3f57c5040ae579d3575c450a04c4e2336bcd1c53: Status 404 returned error can't find the container with id 1b3b93c568bce748ab4630cd3f57c5040ae579d3575c450a04c4e2336bcd1c53 Jul 29 10:30:42.979670 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:42.979644 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f5fcc949-n2kp9"] Jul 29 10:30:43.009977 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.009949 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f5fcc949-n2kp9"] Jul 29 10:30:43.010202 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.010182 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.016944 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.016924 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 10:30:43.066676 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.066634 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mrgw4" Jul 29 10:30:43.108458 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.108417 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-serving-cert\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.108617 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.108464 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-config\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.108617 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.108557 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-service-ca\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.108617 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.108596 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-trusted-ca-bundle\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.108801 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.108652 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-oauth-serving-cert\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.108801 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.108682 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r9ft\" (UniqueName: \"kubernetes.io/projected/8c167f5d-e633-4e69-9476-4ba733ef13a3-kube-api-access-8r9ft\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.108801 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.108781 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-oauth-config\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.210091 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.210010 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-oauth-config\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.210234 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.210123 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-serving-cert\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.210234 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.210150 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-config\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.210234 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.210184 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-service-ca\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.210234 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.210210 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-trusted-ca-bundle\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.210422 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.210236 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-oauth-serving-cert\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.210422 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.210260 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r9ft\" (UniqueName: \"kubernetes.io/projected/8c167f5d-e633-4e69-9476-4ba733ef13a3-kube-api-access-8r9ft\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.211912 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.211806 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-oauth-serving-cert\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.211912 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.211865 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-config\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.212136 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.212101 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-trusted-ca-bundle\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.212560 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.212539 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-service-ca\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.214401 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.214375 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-oauth-config\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.214941 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.214918 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-serving-cert\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.218645 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.218623 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r9ft\" (UniqueName: \"kubernetes.io/projected/8c167f5d-e633-4e69-9476-4ba733ef13a3-kube-api-access-8r9ft\") pod \"console-59f5fcc949-n2kp9\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:43.225427 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.225395 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" event={"ID":"754389d2-e463-48b4-8149-6c87132c18cd","Type":"ContainerStarted","Data":"1b3b93c568bce748ab4630cd3f57c5040ae579d3575c450a04c4e2336bcd1c53"} Jul 29 10:30:43.228358 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.228195 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" event={"ID":"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc","Type":"ContainerStarted","Data":"1d02bd875d959bb991a82a42e751f31f0e4c55c4389ced5023ed77fdeabf6a6a"} Jul 29 10:30:43.228358 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.228277 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" event={"ID":"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc","Type":"ContainerStarted","Data":"151a526394eb3f3479be93856bd01f235a141365f26d0b52baf653c60c9d2988"} Jul 29 10:30:43.228358 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.228321 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" event={"ID":"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc","Type":"ContainerStarted","Data":"350aee29eaae4b61365bf36f5809c4d79f1dc01743b1c1cb8de6fe015b4e08a4"} Jul 29 10:30:43.321104 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:43.321069 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:30:44.997990 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:44.997927 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f5fcc949-n2kp9"] Jul 29 10:30:45.001353 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:45.001320 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c167f5d_e633_4e69_9476_4ba733ef13a3.slice/crio-70ec9a2f02f55805b51c104fb46581675adb596f32a03fcda301ccd62050e0db WatchSource:0}: Error finding container 70ec9a2f02f55805b51c104fb46581675adb596f32a03fcda301ccd62050e0db: Status 404 returned error can't find the container with id 70ec9a2f02f55805b51c104fb46581675adb596f32a03fcda301ccd62050e0db Jul 29 10:30:45.120597 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:45.120576 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54f49b87dc-wzxbl" Jul 29 10:30:45.239739 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:45.239657 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f5fcc949-n2kp9" event={"ID":"8c167f5d-e633-4e69-9476-4ba733ef13a3","Type":"ContainerStarted","Data":"70ec9a2f02f55805b51c104fb46581675adb596f32a03fcda301ccd62050e0db"} Jul 29 10:30:45.241449 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:45.241416 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerStarted","Data":"a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f"} Jul 29 10:30:45.242997 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:45.242976 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" event={"ID":"754389d2-e463-48b4-8149-6c87132c18cd","Type":"ContainerStarted","Data":"0b87e2ab86bf62b3a93eb253d54bc717b9737f5167f813f2793b2d59eb9c133b"} Jul 29 10:30:45.243086 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:45.243019 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" event={"ID":"754389d2-e463-48b4-8149-6c87132c18cd","Type":"ContainerStarted","Data":"0541ecaae7b2ba262e02d359e6f94424a8293a1e5cd75de2aab8bea7769dfb47"} Jul 29 10:30:46.249290 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.249254 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" event={"ID":"754389d2-e463-48b4-8149-6c87132c18cd","Type":"ContainerStarted","Data":"c5270292423e4748f7221ef169383839b88fb3a667d51f8926ff59cfa5b4b7f4"} Jul 29 10:30:46.250946 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.250917 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f5fcc949-n2kp9" event={"ID":"8c167f5d-e633-4e69-9476-4ba733ef13a3","Type":"ContainerStarted","Data":"ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a"} Jul 29 10:30:46.254369 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.254344 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerStarted","Data":"398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62"} Jul 29 10:30:46.254469 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.254395 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerStarted","Data":"ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63"} Jul 29 10:30:46.254469 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.254421 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerStarted","Data":"b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39"} Jul 29 10:30:46.254469 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.254460 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerStarted","Data":"b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b"} Jul 29 10:30:46.254612 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.254486 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerStarted","Data":"1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d"} Jul 29 10:30:46.257075 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.257049 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" event={"ID":"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc","Type":"ContainerStarted","Data":"2ea7161cbb1cf26817e129238e5cb148d78f352b396a34d484c8c7db06d6d323"} Jul 29 10:30:46.257178 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.257106 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" event={"ID":"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc","Type":"ContainerStarted","Data":"643d8ef0c1e9029b6bb34d92fca804fd9e459de7c13368ecf3f7f4e9a835f523"} Jul 29 10:30:46.257178 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.257132 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" event={"ID":"47b31d24-8ec0-4cc0-8c92-d2596d9b49fc","Type":"ContainerStarted","Data":"52c706f52cf5337d8462c3f7ec0841cfbbaac4e354b9ad2735f541973476795b"} Jul 29 10:30:46.257178 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.257166 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:46.270328 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.270284 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-84f855f498-fjxnx" podStartSLOduration=2.883304559 podStartE2EDuration="5.27027128s" totalImagesPullingTime="2.386966721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:46.268157553 +0000 UTC m=+106.018056210" watchObservedRunningTime="2026-07-29 10:30:46.27027128 +0000 UTC m=+106.020169913" Jul 29 10:30:46.289009 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.288968 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" podStartSLOduration=2.836901556 podStartE2EDuration="7.288955311s" totalImagesPullingTime="4.452053755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:46.286793202 +0000 UTC m=+106.036691844" watchObservedRunningTime="2026-07-29 10:30:46.288955311 +0000 UTC m=+106.038853944" Jul 29 10:30:46.311469 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.311425 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.708538835 podStartE2EDuration="9.311413641s" totalImagesPullingTime="5.586212034s" totalInitContainerRuntime="16.662772ms" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:46.310005434 +0000 UTC m=+106.059904069" watchObservedRunningTime="2026-07-29 10:30:46.311413641 +0000 UTC m=+106.061312274" Jul 29 10:30:46.327578 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:46.327536 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f5fcc949-n2kp9" podStartSLOduration=4.327520712 podStartE2EDuration="4.327520712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:46.327055208 +0000 UTC m=+106.076953873" watchObservedRunningTime="2026-07-29 10:30:46.327520712 +0000 UTC m=+106.077419347" Jul 29 10:30:47.267439 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:47.267412 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-9ffc76c4-gmmd2" Jul 29 10:30:49.828066 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:49.828035 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f5fcc949-n2kp9"] Jul 29 10:30:49.855633 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:49.855608 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59cb78c588-krwhj"] Jul 29 10:30:49.888645 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:49.888621 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cb78c588-krwhj"] Jul 29 10:30:49.888804 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:49.888721 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:49.967934 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:49.967909 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-config\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:49.968038 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:49.967936 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb2qd\" (UniqueName: \"kubernetes.io/projected/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-kube-api-access-qb2qd\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:49.968038 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:49.968004 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-serving-cert\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:49.968108 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:49.968037 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-service-ca\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:49.968144 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:49.968103 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-trusted-ca-bundle\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:49.968144 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:49.968121 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-oauth-serving-cert\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:49.968205 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:49.968182 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-oauth-config\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.069441 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.069419 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-serving-cert\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.069548 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.069446 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-service-ca\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.069548 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.069467 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-trusted-ca-bundle\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.069548 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.069482 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-oauth-serving-cert\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.069778 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.069756 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-oauth-config\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.069855 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.069803 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-config\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.069855 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.069832 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2qd\" (UniqueName: \"kubernetes.io/projected/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-kube-api-access-qb2qd\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.070351 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.070321 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-service-ca\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.070438 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.070362 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-oauth-serving-cert\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.070644 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.070620 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-config\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.070848 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.070832 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-trusted-ca-bundle\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.072304 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.072286 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-oauth-config\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.072538 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.072517 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-serving-cert\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.077431 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.077410 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb2qd\" (UniqueName: \"kubernetes.io/projected/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-kube-api-access-qb2qd\") pod \"console-59cb78c588-krwhj\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.197557 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.197505 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:30:50.359141 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:50.356026 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cb78c588-krwhj"] Jul 29 10:30:50.360593 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:30:50.360568 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b56f2eb_f4ba_4b3a_85e2_3179051373fe.slice/crio-7c0a5249a6f705580f269c0ab2b98161b749dcc1d87c67a0cd8e3cb869234529 WatchSource:0}: Error finding container 7c0a5249a6f705580f269c0ab2b98161b749dcc1d87c67a0cd8e3cb869234529: Status 404 returned error can't find the container with id 7c0a5249a6f705580f269c0ab2b98161b749dcc1d87c67a0cd8e3cb869234529 Jul 29 10:30:51.280319 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:51.280284 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cb78c588-krwhj" event={"ID":"0b56f2eb-f4ba-4b3a-85e2-3179051373fe","Type":"ContainerStarted","Data":"94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3"} Jul 29 10:30:51.280674 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:51.280333 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cb78c588-krwhj" event={"ID":"0b56f2eb-f4ba-4b3a-85e2-3179051373fe","Type":"ContainerStarted","Data":"7c0a5249a6f705580f269c0ab2b98161b749dcc1d87c67a0cd8e3cb869234529"} Jul 29 10:30:51.302028 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:51.301975 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59cb78c588-krwhj" podStartSLOduration=2.301961366 podStartE2EDuration="2.301961366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:51.300424085 +0000 UTC m=+111.050322719" watchObservedRunningTime="2026-07-29 10:30:51.301961366 +0000 UTC m=+111.051860000" Jul 29 10:30:53.322072 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:30:53.322041 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:31:00.197789 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:00.197738 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:31:00.198266 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:00.197830 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:31:00.202719 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:00.202680 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:31:00.319768 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:00.319744 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:31:00.368864 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:00.368835 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6f9995c-692q7"] Jul 29 10:31:10.441587 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:10.441554 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:31:10.443844 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:10.443815 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2b8b47-f121-4b15-8595-7152e2d10091-metrics-certs\") pod \"network-metrics-daemon-hpzsh\" (UID: \"3b2b8b47-f121-4b15-8595-7152e2d10091\") " pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:31:10.592001 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:10.591972 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n9sqp\"" Jul 29 10:31:10.600448 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:10.600421 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpzsh" Jul 29 10:31:10.749200 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:10.749173 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hpzsh"] Jul 29 10:31:10.752227 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:31:10.752202 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b2b8b47_f121_4b15_8595_7152e2d10091.slice/crio-38e2b33eb03900ffb75bf6acec3bb796fbcb7b120acba8440d71cfc54847689f WatchSource:0}: Error finding container 38e2b33eb03900ffb75bf6acec3bb796fbcb7b120acba8440d71cfc54847689f: Status 404 returned error can't find the container with id 38e2b33eb03900ffb75bf6acec3bb796fbcb7b120acba8440d71cfc54847689f Jul 29 10:31:11.360411 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:11.360379 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hpzsh" event={"ID":"3b2b8b47-f121-4b15-8595-7152e2d10091","Type":"ContainerStarted","Data":"38e2b33eb03900ffb75bf6acec3bb796fbcb7b120acba8440d71cfc54847689f"} Jul 29 10:31:13.370023 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:13.369986 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hpzsh" event={"ID":"3b2b8b47-f121-4b15-8595-7152e2d10091","Type":"ContainerStarted","Data":"3e6f0b4b1689579b6ede7d1f116eed27e83619940396d769e9500583a5d1d123"} Jul 29 10:31:13.370388 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:13.370046 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hpzsh" event={"ID":"3b2b8b47-f121-4b15-8595-7152e2d10091","Type":"ContainerStarted","Data":"9c3989ca65e5a5641413bff9451743975e92df7d61f8c249c6002d4ce28ba21e"} Jul 29 10:31:13.386067 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:13.386016 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hpzsh" podStartSLOduration=131.881843128 podStartE2EDuration="2m13.386001911s" totalImagesPullingTime="1.504158783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:31:13.385138036 +0000 UTC m=+133.135036671" watchObservedRunningTime="2026-07-29 10:31:13.386001911 +0000 UTC m=+133.135900607" Jul 29 10:31:14.847205 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:14.847160 2517 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59f5fcc949-n2kp9" podUID="8c167f5d-e633-4e69-9476-4ba733ef13a3" containerName="console" containerID="cri-o://ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a" gracePeriod=15 Jul 29 10:31:15.089221 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.089196 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:31:15.181219 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.181154 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-oauth-serving-cert\") pod \"8c167f5d-e633-4e69-9476-4ba733ef13a3\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " Jul 29 10:31:15.181219 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.181188 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-serving-cert\") pod \"8c167f5d-e633-4e69-9476-4ba733ef13a3\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " Jul 29 10:31:15.181219 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.181204 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-oauth-config\") pod \"8c167f5d-e633-4e69-9476-4ba733ef13a3\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " Jul 29 10:31:15.181445 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.181239 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-config\") pod \"8c167f5d-e633-4e69-9476-4ba733ef13a3\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " Jul 29 10:31:15.181445 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.181292 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-service-ca\") pod \"8c167f5d-e633-4e69-9476-4ba733ef13a3\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " Jul 29 10:31:15.181445 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.181324 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r9ft\" (UniqueName: \"kubernetes.io/projected/8c167f5d-e633-4e69-9476-4ba733ef13a3-kube-api-access-8r9ft\") pod \"8c167f5d-e633-4e69-9476-4ba733ef13a3\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " Jul 29 10:31:15.181445 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.181384 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-trusted-ca-bundle\") pod \"8c167f5d-e633-4e69-9476-4ba733ef13a3\" (UID: \"8c167f5d-e633-4e69-9476-4ba733ef13a3\") " Jul 29 10:31:15.181682 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.181650 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8c167f5d-e633-4e69-9476-4ba733ef13a3" (UID: "8c167f5d-e633-4e69-9476-4ba733ef13a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:31:15.181856 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.181825 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "8c167f5d-e633-4e69-9476-4ba733ef13a3" (UID: "8c167f5d-e633-4e69-9476-4ba733ef13a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:31:15.181923 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.181830 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-config" (OuterVolumeSpecName: "console-config") pod "8c167f5d-e633-4e69-9476-4ba733ef13a3" (UID: "8c167f5d-e633-4e69-9476-4ba733ef13a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:31:15.181985 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.181937 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8c167f5d-e633-4e69-9476-4ba733ef13a3" (UID: "8c167f5d-e633-4e69-9476-4ba733ef13a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:31:15.183467 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.183443 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c167f5d-e633-4e69-9476-4ba733ef13a3-kube-api-access-8r9ft" (OuterVolumeSpecName: "kube-api-access-8r9ft") pod "8c167f5d-e633-4e69-9476-4ba733ef13a3" (UID: "8c167f5d-e633-4e69-9476-4ba733ef13a3"). InnerVolumeSpecName "kube-api-access-8r9ft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:31:15.183467 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.183454 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8c167f5d-e633-4e69-9476-4ba733ef13a3" (UID: "8c167f5d-e633-4e69-9476-4ba733ef13a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:31:15.183592 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.183441 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8c167f5d-e633-4e69-9476-4ba733ef13a3" (UID: "8c167f5d-e633-4e69-9476-4ba733ef13a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:31:15.282951 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.282918 2517 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-service-ca\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:15.282951 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.282951 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r9ft\" (UniqueName: \"kubernetes.io/projected/8c167f5d-e633-4e69-9476-4ba733ef13a3-kube-api-access-8r9ft\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:15.282951 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.282961 2517 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-trusted-ca-bundle\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:15.283135 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.282972 2517 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-oauth-serving-cert\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:15.283135 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.282980 2517 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-serving-cert\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:15.283135 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.282996 2517 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-oauth-config\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:15.283135 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.283005 2517 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c167f5d-e633-4e69-9476-4ba733ef13a3-console-config\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:15.378664 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.378634 2517 generic.go:356] "Generic (PLEG): container finished" podID="8c167f5d-e633-4e69-9476-4ba733ef13a3" containerID="ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a" exitCode=0 Jul 29 10:31:15.378786 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.378679 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f5fcc949-n2kp9" Jul 29 10:31:15.378786 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.378726 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f5fcc949-n2kp9" event={"ID":"8c167f5d-e633-4e69-9476-4ba733ef13a3","Type":"ContainerDied","Data":"ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a"} Jul 29 10:31:15.378786 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.378775 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f5fcc949-n2kp9" event={"ID":"8c167f5d-e633-4e69-9476-4ba733ef13a3","Type":"ContainerDied","Data":"70ec9a2f02f55805b51c104fb46581675adb596f32a03fcda301ccd62050e0db"} Jul 29 10:31:15.378894 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.378795 2517 scope.go:117] "RemoveContainer" containerID="ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a" Jul 29 10:31:15.390691 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.390675 2517 scope.go:117] "RemoveContainer" containerID="ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a" Jul 29 10:31:15.390957 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:31:15.390938 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a\": container with ID starting with ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a not found: ID does not exist" containerID="ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a" Jul 29 10:31:15.391045 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.390970 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a"} err="failed to get container status \"ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a\": rpc error: code = NotFound desc = could not find container \"ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a\": container with ID starting with ed2d940abc2df1e091a4ace3b28c246ebd105262877844c461035fc10321d77a not found: ID does not exist" Jul 29 10:31:15.399920 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.399900 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f5fcc949-n2kp9"] Jul 29 10:31:15.403539 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:15.403519 2517 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59f5fcc949-n2kp9"] Jul 29 10:31:16.768513 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:16.768480 2517 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c167f5d-e633-4e69-9476-4ba733ef13a3" path="/var/lib/kubelet/pods/8c167f5d-e633-4e69-9476-4ba733ef13a3/volumes" Jul 29 10:31:25.390532 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.390466 2517 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c6f9995c-692q7" podUID="73b66f65-719e-485b-9b73-733a2bd4a349" containerName="console" containerID="cri-o://2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb" gracePeriod=15 Jul 29 10:31:25.629947 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.629925 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:31:25.760041 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.760014 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-console-config\") pod \"73b66f65-719e-485b-9b73-733a2bd4a349\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " Jul 29 10:31:25.760167 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.760070 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8xr8\" (UniqueName: \"kubernetes.io/projected/73b66f65-719e-485b-9b73-733a2bd4a349-kube-api-access-h8xr8\") pod \"73b66f65-719e-485b-9b73-733a2bd4a349\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " Jul 29 10:31:25.760167 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.760125 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-oauth-config\") pod \"73b66f65-719e-485b-9b73-733a2bd4a349\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " Jul 29 10:31:25.760167 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.760143 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-serving-cert\") pod \"73b66f65-719e-485b-9b73-733a2bd4a349\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " Jul 29 10:31:25.760271 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.760185 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-service-ca\") pod \"73b66f65-719e-485b-9b73-733a2bd4a349\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " Jul 29 10:31:25.760271 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.760214 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-oauth-serving-cert\") pod \"73b66f65-719e-485b-9b73-733a2bd4a349\" (UID: \"73b66f65-719e-485b-9b73-733a2bd4a349\") " Jul 29 10:31:25.760465 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.760396 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-console-config" (OuterVolumeSpecName: "console-config") pod "73b66f65-719e-485b-9b73-733a2bd4a349" (UID: "73b66f65-719e-485b-9b73-733a2bd4a349"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:31:25.760600 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.760574 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-service-ca" (OuterVolumeSpecName: "service-ca") pod "73b66f65-719e-485b-9b73-733a2bd4a349" (UID: "73b66f65-719e-485b-9b73-733a2bd4a349"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:31:25.760733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.760677 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "73b66f65-719e-485b-9b73-733a2bd4a349" (UID: "73b66f65-719e-485b-9b73-733a2bd4a349"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:31:25.762280 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.762259 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "73b66f65-719e-485b-9b73-733a2bd4a349" (UID: "73b66f65-719e-485b-9b73-733a2bd4a349"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:31:25.762376 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.762276 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73b66f65-719e-485b-9b73-733a2bd4a349-kube-api-access-h8xr8" (OuterVolumeSpecName: "kube-api-access-h8xr8") pod "73b66f65-719e-485b-9b73-733a2bd4a349" (UID: "73b66f65-719e-485b-9b73-733a2bd4a349"). InnerVolumeSpecName "kube-api-access-h8xr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:31:25.762376 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.762307 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "73b66f65-719e-485b-9b73-733a2bd4a349" (UID: "73b66f65-719e-485b-9b73-733a2bd4a349"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:31:25.861102 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.861077 2517 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-service-ca\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:25.861102 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.861098 2517 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-oauth-serving-cert\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:25.861102 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.861107 2517 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73b66f65-719e-485b-9b73-733a2bd4a349-console-config\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:25.861273 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.861116 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8xr8\" (UniqueName: \"kubernetes.io/projected/73b66f65-719e-485b-9b73-733a2bd4a349-kube-api-access-h8xr8\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:25.861273 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.861125 2517 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-oauth-config\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:25.861273 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:25.861134 2517 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73b66f65-719e-485b-9b73-733a2bd4a349-console-serving-cert\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:26.425645 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:26.425608 2517 generic.go:356] "Generic (PLEG): container finished" podID="73b66f65-719e-485b-9b73-733a2bd4a349" containerID="2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb" exitCode=0 Jul 29 10:31:26.426050 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:26.425655 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6f9995c-692q7" Jul 29 10:31:26.426050 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:26.425665 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6f9995c-692q7" event={"ID":"73b66f65-719e-485b-9b73-733a2bd4a349","Type":"ContainerDied","Data":"2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb"} Jul 29 10:31:26.426050 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:26.425735 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6f9995c-692q7" event={"ID":"73b66f65-719e-485b-9b73-733a2bd4a349","Type":"ContainerDied","Data":"031faf17a22823a50f9c9bc6f0d41564e7f205bdee9ce4482f4701c04367b407"} Jul 29 10:31:26.426050 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:26.425765 2517 scope.go:117] "RemoveContainer" containerID="2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb" Jul 29 10:31:26.434673 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:26.434656 2517 scope.go:117] "RemoveContainer" containerID="2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb" Jul 29 10:31:26.434931 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:31:26.434911 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb\": container with ID starting with 2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb not found: ID does not exist" containerID="2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb" Jul 29 10:31:26.434977 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:26.434939 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb"} err="failed to get container status \"2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb\": rpc error: code = NotFound desc = could not find container \"2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb\": container with ID starting with 2c1d1173800475810d5b0f8aaf1ee16600960ed06658d150bc72a6fba86de8eb not found: ID does not exist" Jul 29 10:31:26.445553 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:26.445532 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6f9995c-692q7"] Jul 29 10:31:26.449774 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:26.449754 2517 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c6f9995c-692q7"] Jul 29 10:31:26.769516 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:26.769487 2517 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73b66f65-719e-485b-9b73-733a2bd4a349" path="/var/lib/kubelet/pods/73b66f65-719e-485b-9b73-733a2bd4a349/volumes" Jul 29 10:31:55.042107 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.042039 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ff8654496-9kb59"] Jul 29 10:31:55.042532 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.042355 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c167f5d-e633-4e69-9476-4ba733ef13a3" containerName="console" Jul 29 10:31:55.042532 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.042367 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c167f5d-e633-4e69-9476-4ba733ef13a3" containerName="console" Jul 29 10:31:55.042532 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.042389 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73b66f65-719e-485b-9b73-733a2bd4a349" containerName="console" Jul 29 10:31:55.042532 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.042394 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="73b66f65-719e-485b-9b73-733a2bd4a349" containerName="console" Jul 29 10:31:55.042532 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.042446 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="73b66f65-719e-485b-9b73-733a2bd4a349" containerName="console" Jul 29 10:31:55.042532 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.042457 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c167f5d-e633-4e69-9476-4ba733ef13a3" containerName="console" Jul 29 10:31:55.044583 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.044567 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.057118 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.057095 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ff8654496-9kb59"] Jul 29 10:31:55.173135 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.173111 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-oauth-config\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.173241 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.173142 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbsm5\" (UniqueName: \"kubernetes.io/projected/67cbc502-4f05-41c6-a9ce-a9d7958c2996-kube-api-access-vbsm5\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.173241 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.173210 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-serving-cert\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.173311 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.173250 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-oauth-serving-cert\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.173311 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.173271 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-config\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.173311 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.173288 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-trusted-ca-bundle\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.173398 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.173365 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-service-ca\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.274419 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.274394 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-serving-cert\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.274559 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.274428 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-oauth-serving-cert\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.274559 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.274445 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-config\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.274559 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.274460 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-trusted-ca-bundle\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.274559 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.274512 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-service-ca\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.274559 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.274541 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-oauth-config\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.274802 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.274571 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbsm5\" (UniqueName: \"kubernetes.io/projected/67cbc502-4f05-41c6-a9ce-a9d7958c2996-kube-api-access-vbsm5\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.275246 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.275220 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-oauth-serving-cert\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.275344 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.275323 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-config\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.275434 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.275409 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-service-ca\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.275470 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.275426 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-trusted-ca-bundle\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.276942 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.276916 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-serving-cert\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.277038 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.277020 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-oauth-config\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.281842 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.281816 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbsm5\" (UniqueName: \"kubernetes.io/projected/67cbc502-4f05-41c6-a9ce-a9d7958c2996-kube-api-access-vbsm5\") pod \"console-5ff8654496-9kb59\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.353736 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.353667 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:31:55.481181 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.481143 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ff8654496-9kb59"] Jul 29 10:31:55.485015 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:31:55.484985 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67cbc502_4f05_41c6_a9ce_a9d7958c2996.slice/crio-257a535b6e4082cb3706255a12c529d2735e022ab9b5f8a08985b2bd77b3cc64 WatchSource:0}: Error finding container 257a535b6e4082cb3706255a12c529d2735e022ab9b5f8a08985b2bd77b3cc64: Status 404 returned error can't find the container with id 257a535b6e4082cb3706255a12c529d2735e022ab9b5f8a08985b2bd77b3cc64 Jul 29 10:31:55.543441 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:55.543414 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ff8654496-9kb59" event={"ID":"67cbc502-4f05-41c6-a9ce-a9d7958c2996","Type":"ContainerStarted","Data":"257a535b6e4082cb3706255a12c529d2735e022ab9b5f8a08985b2bd77b3cc64"} Jul 29 10:31:56.549237 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:56.549202 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ff8654496-9kb59" event={"ID":"67cbc502-4f05-41c6-a9ce-a9d7958c2996","Type":"ContainerStarted","Data":"aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5"} Jul 29 10:31:56.567695 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:56.567641 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ff8654496-9kb59" podStartSLOduration=1.567626689 podStartE2EDuration="1.567626689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:31:56.56698726 +0000 UTC m=+176.316885893" watchObservedRunningTime="2026-07-29 10:31:56.567626689 +0000 UTC m=+176.317525317" Jul 29 10:31:56.797489 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:56.797460 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:31:56.797743 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:56.797721 2517 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="alertmanager" containerID="cri-o://a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f" gracePeriod=120 Jul 29 10:31:56.797820 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:56.797762 2517 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy-metric" containerID="cri-o://ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63" gracePeriod=120 Jul 29 10:31:56.797820 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:56.797784 2517 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="prom-label-proxy" containerID="cri-o://398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62" gracePeriod=120 Jul 29 10:31:56.797932 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:56.797856 2517 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy-web" containerID="cri-o://b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b" gracePeriod=120 Jul 29 10:31:56.797982 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:56.797861 2517 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy" containerID="cri-o://b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39" gracePeriod=120 Jul 29 10:31:56.798031 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:56.797864 2517 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="config-reloader" containerID="cri-o://1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d" gracePeriod=120 Jul 29 10:31:57.556649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:57.556619 2517 generic.go:356] "Generic (PLEG): container finished" podID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerID="398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62" exitCode=0 Jul 29 10:31:57.556649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:57.556643 2517 generic.go:356] "Generic (PLEG): container finished" podID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerID="b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39" exitCode=0 Jul 29 10:31:57.556649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:57.556649 2517 generic.go:356] "Generic (PLEG): container finished" podID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerID="1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d" exitCode=0 Jul 29 10:31:57.556649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:57.556654 2517 generic.go:356] "Generic (PLEG): container finished" podID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerID="a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f" exitCode=0 Jul 29 10:31:57.557102 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:57.556692 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerDied","Data":"398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62"} Jul 29 10:31:57.557102 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:57.556773 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerDied","Data":"b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39"} Jul 29 10:31:57.557102 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:57.556802 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerDied","Data":"1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d"} Jul 29 10:31:57.557102 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:57.556826 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerDied","Data":"a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f"} Jul 29 10:31:58.055275 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.055253 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.096845 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.096820 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.096970 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.096860 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-config-out\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.096970 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.096886 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-cluster-tls-config\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.096970 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.096917 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-metrics-client-ca\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.096970 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.096949 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-tls-assets\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.097204 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.096991 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-trusted-ca-bundle\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.097204 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.097016 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.097204 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.097038 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng2ss\" (UniqueName: \"kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-kube-api-access-ng2ss\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.097204 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.097066 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-main-db\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.097204 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.097102 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-web-config\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.097204 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.097138 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-config-volume\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.097204 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.097183 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-main-tls\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.097537 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.097208 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-web\") pod \"03ad7757-d6ed-4c38-a292-92b3debf5166\" (UID: \"03ad7757-d6ed-4c38-a292-92b3debf5166\") " Jul 29 10:31:58.097537 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.097503 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:31:58.099216 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.099008 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:31:58.099512 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.099479 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:31:58.099608 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.099512 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:31:58.101672 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.101635 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-config-out" (OuterVolumeSpecName: "config-out") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:31:58.102527 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.102491 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:31:58.103507 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.103384 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-kube-api-access-ng2ss" (OuterVolumeSpecName: "kube-api-access-ng2ss") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "kube-api-access-ng2ss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:31:58.103507 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.103451 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-config-volume" (OuterVolumeSpecName: "config-volume") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:31:58.103640 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.103545 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:31:58.104036 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.104006 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:31:58.104244 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.104221 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:31:58.107288 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.107261 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:31:58.114840 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.114818 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-web-config" (OuterVolumeSpecName: "web-config") pod "03ad7757-d6ed-4c38-a292-92b3debf5166" (UID: "03ad7757-d6ed-4c38-a292-92b3debf5166"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:31:58.198314 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198291 2517 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198314 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198313 2517 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198324 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng2ss\" (UniqueName: \"kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-kube-api-access-ng2ss\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198334 2517 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-alertmanager-main-db\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198342 2517 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-web-config\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198350 2517 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-config-volume\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198357 2517 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-main-tls\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198365 2517 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198374 2517 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198383 2517 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03ad7757-d6ed-4c38-a292-92b3debf5166-config-out\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198392 2517 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03ad7757-d6ed-4c38-a292-92b3debf5166-cluster-tls-config\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198400 2517 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03ad7757-d6ed-4c38-a292-92b3debf5166-metrics-client-ca\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.198435 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.198407 2517 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03ad7757-d6ed-4c38-a292-92b3debf5166-tls-assets\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:31:58.563386 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.563349 2517 generic.go:356] "Generic (PLEG): container finished" podID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerID="ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63" exitCode=0 Jul 29 10:31:58.563386 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.563378 2517 generic.go:356] "Generic (PLEG): container finished" podID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerID="b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b" exitCode=0 Jul 29 10:31:58.563856 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.563423 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.563856 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.563429 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerDied","Data":"ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63"} Jul 29 10:31:58.563856 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.563497 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerDied","Data":"b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b"} Jul 29 10:31:58.563856 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.563524 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03ad7757-d6ed-4c38-a292-92b3debf5166","Type":"ContainerDied","Data":"e93c27b09e08359d3d92c6f125aa42ac2a8d405c0cc33471e3104fd5acac12c5"} Jul 29 10:31:58.563856 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.563557 2517 scope.go:117] "RemoveContainer" containerID="398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62" Jul 29 10:31:58.571275 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.571251 2517 scope.go:117] "RemoveContainer" containerID="ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63" Jul 29 10:31:58.580136 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.580115 2517 scope.go:117] "RemoveContainer" containerID="b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39" Jul 29 10:31:58.586571 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.586551 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:31:58.587291 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.587276 2517 scope.go:117] "RemoveContainer" containerID="b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b" Jul 29 10:31:58.590465 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.590445 2517 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:31:58.594058 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.594043 2517 scope.go:117] "RemoveContainer" containerID="1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d" Jul 29 10:31:58.600541 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.600520 2517 scope.go:117] "RemoveContainer" containerID="a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f" Jul 29 10:31:58.607043 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.607025 2517 scope.go:117] "RemoveContainer" containerID="a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c" Jul 29 10:31:58.613658 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.613646 2517 scope.go:117] "RemoveContainer" containerID="398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62" Jul 29 10:31:58.613895 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:31:58.613878 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62\": container with ID starting with 398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62 not found: ID does not exist" containerID="398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62" Jul 29 10:31:58.613952 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.613903 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62"} err="failed to get container status \"398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62\": rpc error: code = NotFound desc = could not find container \"398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62\": container with ID starting with 398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62 not found: ID does not exist" Jul 29 10:31:58.613952 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.613929 2517 scope.go:117] "RemoveContainer" containerID="ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63" Jul 29 10:31:58.614132 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:31:58.614117 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63\": container with ID starting with ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63 not found: ID does not exist" containerID="ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63" Jul 29 10:31:58.614171 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.614136 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63"} err="failed to get container status \"ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63\": rpc error: code = NotFound desc = could not find container \"ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63\": container with ID starting with ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63 not found: ID does not exist" Jul 29 10:31:58.614171 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.614149 2517 scope.go:117] "RemoveContainer" containerID="b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39" Jul 29 10:31:58.614330 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:31:58.614317 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39\": container with ID starting with b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39 not found: ID does not exist" containerID="b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39" Jul 29 10:31:58.614366 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.614335 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39"} err="failed to get container status \"b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39\": rpc error: code = NotFound desc = could not find container \"b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39\": container with ID starting with b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39 not found: ID does not exist" Jul 29 10:31:58.614366 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.614356 2517 scope.go:117] "RemoveContainer" containerID="b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b" Jul 29 10:31:58.614586 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:31:58.614568 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b\": container with ID starting with b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b not found: ID does not exist" containerID="b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b" Jul 29 10:31:58.614626 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.614592 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b"} err="failed to get container status \"b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b\": rpc error: code = NotFound desc = could not find container \"b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b\": container with ID starting with b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b not found: ID does not exist" Jul 29 10:31:58.614626 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.614608 2517 scope.go:117] "RemoveContainer" containerID="1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d" Jul 29 10:31:58.614863 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:31:58.614844 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d\": container with ID starting with 1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d not found: ID does not exist" containerID="1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d" Jul 29 10:31:58.614912 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.614876 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d"} err="failed to get container status \"1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d\": rpc error: code = NotFound desc = could not find container \"1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d\": container with ID starting with 1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d not found: ID does not exist" Jul 29 10:31:58.614912 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.614890 2517 scope.go:117] "RemoveContainer" containerID="a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f" Jul 29 10:31:58.615138 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:31:58.615121 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f\": container with ID starting with a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f not found: ID does not exist" containerID="a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f" Jul 29 10:31:58.615182 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.615142 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f"} err="failed to get container status \"a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f\": rpc error: code = NotFound desc = could not find container \"a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f\": container with ID starting with a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f not found: ID does not exist" Jul 29 10:31:58.615182 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.615154 2517 scope.go:117] "RemoveContainer" containerID="a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c" Jul 29 10:31:58.615381 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:31:58.615365 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c\": container with ID starting with a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c not found: ID does not exist" containerID="a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c" Jul 29 10:31:58.615423 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.615386 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c"} err="failed to get container status \"a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c\": rpc error: code = NotFound desc = could not find container \"a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c\": container with ID starting with a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c not found: ID does not exist" Jul 29 10:31:58.615423 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.615402 2517 scope.go:117] "RemoveContainer" containerID="398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62" Jul 29 10:31:58.615649 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.615632 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62"} err="failed to get container status \"398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62\": rpc error: code = NotFound desc = could not find container \"398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62\": container with ID starting with 398e3ef56735bfbcfe50fde23763df2a0c27f72d380708cf88cf9ba43e80fa62 not found: ID does not exist" Jul 29 10:31:58.615690 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.615650 2517 scope.go:117] "RemoveContainer" containerID="ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63" Jul 29 10:31:58.615969 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.615932 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63"} err="failed to get container status \"ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63\": rpc error: code = NotFound desc = could not find container \"ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63\": container with ID starting with ca192b0ae3a4f4079c9cd7fb80893a27b170292925ff5fdb28ad79fbe1496a63 not found: ID does not exist" Jul 29 10:31:58.616067 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.615969 2517 scope.go:117] "RemoveContainer" containerID="b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39" Jul 29 10:31:58.616314 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.616287 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39"} err="failed to get container status \"b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39\": rpc error: code = NotFound desc = could not find container \"b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39\": container with ID starting with b574607e76f829e7156a3bcd4e544e87d3d1ce8800271a2b4c212f6c12c66a39 not found: ID does not exist" Jul 29 10:31:58.616314 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.616315 2517 scope.go:117] "RemoveContainer" containerID="b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b" Jul 29 10:31:58.616609 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.616589 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b"} err="failed to get container status \"b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b\": rpc error: code = NotFound desc = could not find container \"b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b\": container with ID starting with b118bb284b0444228101b163b96cd5678e79b4a02d342134d92107a649024b0b not found: ID does not exist" Jul 29 10:31:58.616609 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.616609 2517 scope.go:117] "RemoveContainer" containerID="1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d" Jul 29 10:31:58.616866 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.616847 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d"} err="failed to get container status \"1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d\": rpc error: code = NotFound desc = could not find container \"1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d\": container with ID starting with 1f817827c0a1eeaea6805208c951469f95a42f28e1a44fec458c5d75b2bfa55d not found: ID does not exist" Jul 29 10:31:58.616866 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.616866 2517 scope.go:117] "RemoveContainer" containerID="a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f" Jul 29 10:31:58.617115 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.617097 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f"} err="failed to get container status \"a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f\": rpc error: code = NotFound desc = could not find container \"a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f\": container with ID starting with a4a1c0f5b7846bfb24f809e0b720fee0425fcc09619a3596f9658f69b6d97e4f not found: ID does not exist" Jul 29 10:31:58.617177 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.617117 2517 scope.go:117] "RemoveContainer" containerID="a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c" Jul 29 10:31:58.617375 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.617335 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c"} err="failed to get container status \"a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c\": rpc error: code = NotFound desc = could not find container \"a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c\": container with ID starting with a3885280845df8fe0e7d30cecddef3cb0c81c2a09e91e425bb38b4461799867c not found: ID does not exist" Jul 29 10:31:58.617952 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.617934 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:31:58.618271 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618257 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="init-config-reloader" Jul 29 10:31:58.618302 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618275 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="init-config-reloader" Jul 29 10:31:58.618302 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618286 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="config-reloader" Jul 29 10:31:58.618302 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618291 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="config-reloader" Jul 29 10:31:58.618302 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618298 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy-metric" Jul 29 10:31:58.618420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618304 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy-metric" Jul 29 10:31:58.618420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618311 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy" Jul 29 10:31:58.618420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618316 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy" Jul 29 10:31:58.618420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618323 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="prom-label-proxy" Jul 29 10:31:58.618420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618329 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="prom-label-proxy" Jul 29 10:31:58.618420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618345 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="alertmanager" Jul 29 10:31:58.618420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618352 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="alertmanager" Jul 29 10:31:58.618420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618357 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy-web" Jul 29 10:31:58.618420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618362 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy-web" Jul 29 10:31:58.618420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618409 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="alertmanager" Jul 29 10:31:58.618420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618421 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy" Jul 29 10:31:58.618739 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618428 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="config-reloader" Jul 29 10:31:58.618739 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618433 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy-web" Jul 29 10:31:58.618739 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618440 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="kube-rbac-proxy-metric" Jul 29 10:31:58.618739 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.618446 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" containerName="prom-label-proxy" Jul 29 10:31:58.621780 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.621764 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.623658 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.623641 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 10:31:58.623769 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.623662 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 10:31:58.623911 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.623896 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 10:31:58.623980 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.623962 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 10:31:58.624160 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.624140 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qfzmc\"" Jul 29 10:31:58.624260 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.624159 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 10:31:58.624260 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.624176 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 10:31:58.624260 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.624198 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 10:31:58.624416 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.624161 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 10:31:58.628755 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.628737 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 10:31:58.636291 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.636259 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:31:58.701238 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701212 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701356 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701246 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701356 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701262 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701356 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701332 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ae2cddb-9a16-4541-8670-b396d7eec4fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701447 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701382 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae2cddb-9a16-4541-8670-b396d7eec4fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701447 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701403 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6nkp\" (UniqueName: \"kubernetes.io/projected/9ae2cddb-9a16-4541-8670-b396d7eec4fa-kube-api-access-n6nkp\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701447 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701419 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-web-config\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701533 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701480 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ae2cddb-9a16-4541-8670-b396d7eec4fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701533 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701502 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701533 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701528 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ae2cddb-9a16-4541-8670-b396d7eec4fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701615 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701550 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701615 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701569 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ae2cddb-9a16-4541-8670-b396d7eec4fa-config-out\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.701615 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.701590 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.768285 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.768249 2517 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03ad7757-d6ed-4c38-a292-92b3debf5166" path="/var/lib/kubelet/pods/03ad7757-d6ed-4c38-a292-92b3debf5166/volumes" Jul 29 10:31:58.802568 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802543 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.802676 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802574 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.802676 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802603 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ae2cddb-9a16-4541-8670-b396d7eec4fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.802676 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802642 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae2cddb-9a16-4541-8670-b396d7eec4fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.802676 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802671 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6nkp\" (UniqueName: \"kubernetes.io/projected/9ae2cddb-9a16-4541-8670-b396d7eec4fa-kube-api-access-n6nkp\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.802900 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802694 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-web-config\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.802900 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802752 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ae2cddb-9a16-4541-8670-b396d7eec4fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.802900 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802777 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.802900 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802814 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ae2cddb-9a16-4541-8670-b396d7eec4fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.802900 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802849 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.802900 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802877 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ae2cddb-9a16-4541-8670-b396d7eec4fa-config-out\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.803198 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802900 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.803198 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.802977 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.803663 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.803507 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ae2cddb-9a16-4541-8670-b396d7eec4fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.803663 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.803606 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae2cddb-9a16-4541-8670-b396d7eec4fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.805899 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.805592 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.805899 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.805592 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-web-config\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.805899 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.805847 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.805899 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.805854 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.805899 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.805873 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.805899 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.805861 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ae2cddb-9a16-4541-8670-b396d7eec4fa-config-out\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.806163 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.805906 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ae2cddb-9a16-4541-8670-b396d7eec4fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.806163 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.806076 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.806224 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.806207 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ae2cddb-9a16-4541-8670-b396d7eec4fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.807363 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.807348 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ae2cddb-9a16-4541-8670-b396d7eec4fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.809901 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.809882 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6nkp\" (UniqueName: \"kubernetes.io/projected/9ae2cddb-9a16-4541-8670-b396d7eec4fa-kube-api-access-n6nkp\") pod \"alertmanager-main-0\" (UID: \"9ae2cddb-9a16-4541-8670-b396d7eec4fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:58.931825 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:58.931807 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:31:59.065509 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:59.065488 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:31:59.067680 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:31:59.067650 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae2cddb_9a16_4541_8670_b396d7eec4fa.slice/crio-87001c2256d1340f98bec7712d06d5e135b685c7cde43af3f50053e8e010242b WatchSource:0}: Error finding container 87001c2256d1340f98bec7712d06d5e135b685c7cde43af3f50053e8e010242b: Status 404 returned error can't find the container with id 87001c2256d1340f98bec7712d06d5e135b685c7cde43af3f50053e8e010242b Jul 29 10:31:59.570638 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:59.570600 2517 generic.go:356] "Generic (PLEG): container finished" podID="9ae2cddb-9a16-4541-8670-b396d7eec4fa" containerID="4c3758af164b5a06d7e42e3f3285006f295b0bdfea9a0563a49e8471ee0ae5a3" exitCode=0 Jul 29 10:31:59.571018 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:59.570661 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae2cddb-9a16-4541-8670-b396d7eec4fa","Type":"ContainerDied","Data":"4c3758af164b5a06d7e42e3f3285006f295b0bdfea9a0563a49e8471ee0ae5a3"} Jul 29 10:31:59.571018 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:31:59.570728 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae2cddb-9a16-4541-8670-b396d7eec4fa","Type":"ContainerStarted","Data":"87001c2256d1340f98bec7712d06d5e135b685c7cde43af3f50053e8e010242b"} Jul 29 10:32:00.584289 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:00.584256 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae2cddb-9a16-4541-8670-b396d7eec4fa","Type":"ContainerStarted","Data":"e8622e109c3db6b8b95edbbc8da4357257f2d4b40c40812189fb17bffbc10073"} Jul 29 10:32:00.584733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:00.584342 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae2cddb-9a16-4541-8670-b396d7eec4fa","Type":"ContainerStarted","Data":"4e61df44dfa046fd14eddcb12bfbed28d7d8403304ac8573dcfa48ccdec1979d"} Jul 29 10:32:00.584733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:00.584367 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae2cddb-9a16-4541-8670-b396d7eec4fa","Type":"ContainerStarted","Data":"1176e7b3340be2abd7de9bcdd9b898fc08b483cd7b218168237a9a3e2af358f2"} Jul 29 10:32:00.584733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:00.584391 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae2cddb-9a16-4541-8670-b396d7eec4fa","Type":"ContainerStarted","Data":"18f693e7ef59f9ac4942363314ab3d98f3d0cef2d5e954868b7a28a64819c7ba"} Jul 29 10:32:00.584733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:00.584418 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae2cddb-9a16-4541-8670-b396d7eec4fa","Type":"ContainerStarted","Data":"b1b696e8c66f7a41bd4006a34011db3117ae4cf8f8d39ce9f1d6d557f0474e7f"} Jul 29 10:32:00.584733 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:00.584441 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae2cddb-9a16-4541-8670-b396d7eec4fa","Type":"ContainerStarted","Data":"a9390093938453522e651b7bf5bcf9acfe00b886e277d07917c2be5b59d0f05e"} Jul 29 10:32:00.609156 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:00.609113 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.5935847929999998 podStartE2EDuration="2.609094551s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.509758ms" isStatefulPod=false podCreationTimestamp="2026-07-29 10:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:32:00.608103959 +0000 UTC m=+180.358002617" watchObservedRunningTime="2026-07-29 10:32:00.609094551 +0000 UTC m=+180.358993183" Jul 29 10:32:05.354038 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:05.354004 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:32:05.354472 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:05.354053 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:32:05.358420 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:05.358401 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:32:05.612666 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:05.612601 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:32:05.655897 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:05.655870 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cb78c588-krwhj"] Jul 29 10:32:30.674903 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:30.674850 2517 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59cb78c588-krwhj" podUID="0b56f2eb-f4ba-4b3a-85e2-3179051373fe" containerName="console" containerID="cri-o://94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3" gracePeriod=15 Jul 29 10:32:30.933990 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:30.933937 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:32:31.047562 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.047537 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-trusted-ca-bundle\") pod \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " Jul 29 10:32:31.047720 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.047598 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-serving-cert\") pod \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " Jul 29 10:32:31.047720 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.047622 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-oauth-config\") pod \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " Jul 29 10:32:31.047720 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.047642 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb2qd\" (UniqueName: \"kubernetes.io/projected/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-kube-api-access-qb2qd\") pod \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " Jul 29 10:32:31.047720 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.047676 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-service-ca\") pod \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " Jul 29 10:32:31.047907 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.047795 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-config\") pod \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " Jul 29 10:32:31.047907 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.047863 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-oauth-serving-cert\") pod \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\" (UID: \"0b56f2eb-f4ba-4b3a-85e2-3179051373fe\") " Jul 29 10:32:31.048019 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.047956 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0b56f2eb-f4ba-4b3a-85e2-3179051373fe" (UID: "0b56f2eb-f4ba-4b3a-85e2-3179051373fe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:32:31.048173 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.048147 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-config" (OuterVolumeSpecName: "console-config") pod "0b56f2eb-f4ba-4b3a-85e2-3179051373fe" (UID: "0b56f2eb-f4ba-4b3a-85e2-3179051373fe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:32:31.048173 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.048078 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-service-ca" (OuterVolumeSpecName: "service-ca") pod "0b56f2eb-f4ba-4b3a-85e2-3179051373fe" (UID: "0b56f2eb-f4ba-4b3a-85e2-3179051373fe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:32:31.048277 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.048229 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0b56f2eb-f4ba-4b3a-85e2-3179051373fe" (UID: "0b56f2eb-f4ba-4b3a-85e2-3179051373fe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:32:31.048327 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.048295 2517 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-service-ca\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:32:31.048327 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.048309 2517 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-config\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:32:31.048327 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.048323 2517 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-oauth-serving-cert\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:32:31.048422 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.048338 2517 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-trusted-ca-bundle\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:32:31.049756 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.049735 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0b56f2eb-f4ba-4b3a-85e2-3179051373fe" (UID: "0b56f2eb-f4ba-4b3a-85e2-3179051373fe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:32:31.050161 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.050143 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0b56f2eb-f4ba-4b3a-85e2-3179051373fe" (UID: "0b56f2eb-f4ba-4b3a-85e2-3179051373fe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:32:31.050211 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.050169 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-kube-api-access-qb2qd" (OuterVolumeSpecName: "kube-api-access-qb2qd") pod "0b56f2eb-f4ba-4b3a-85e2-3179051373fe" (UID: "0b56f2eb-f4ba-4b3a-85e2-3179051373fe"). InnerVolumeSpecName "kube-api-access-qb2qd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:32:31.149627 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.149603 2517 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-serving-cert\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:32:31.149627 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.149623 2517 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-console-oauth-config\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:32:31.149776 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.149633 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb2qd\" (UniqueName: \"kubernetes.io/projected/0b56f2eb-f4ba-4b3a-85e2-3179051373fe-kube-api-access-qb2qd\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:32:31.714820 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.714783 2517 generic.go:356] "Generic (PLEG): container finished" podID="0b56f2eb-f4ba-4b3a-85e2-3179051373fe" containerID="94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3" exitCode=0 Jul 29 10:32:31.715310 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.714833 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cb78c588-krwhj" Jul 29 10:32:31.715310 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.714867 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cb78c588-krwhj" event={"ID":"0b56f2eb-f4ba-4b3a-85e2-3179051373fe","Type":"ContainerDied","Data":"94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3"} Jul 29 10:32:31.715310 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.714926 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cb78c588-krwhj" event={"ID":"0b56f2eb-f4ba-4b3a-85e2-3179051373fe","Type":"ContainerDied","Data":"7c0a5249a6f705580f269c0ab2b98161b749dcc1d87c67a0cd8e3cb869234529"} Jul 29 10:32:31.715310 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.714948 2517 scope.go:117] "RemoveContainer" containerID="94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3" Jul 29 10:32:31.725821 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.725809 2517 scope.go:117] "RemoveContainer" containerID="94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3" Jul 29 10:32:31.726085 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:32:31.726059 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3\": container with ID starting with 94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3 not found: ID does not exist" containerID="94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3" Jul 29 10:32:31.726191 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.726090 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3"} err="failed to get container status \"94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3\": rpc error: code = NotFound desc = could not find container \"94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3\": container with ID starting with 94c1cfa990d9656e8f5d5367d29194b14b33d3acb8b2812e317737f8c66215f3 not found: ID does not exist" Jul 29 10:32:31.735861 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.735841 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cb78c588-krwhj"] Jul 29 10:32:31.740550 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:31.740531 2517 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59cb78c588-krwhj"] Jul 29 10:32:32.768177 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:32:32.768145 2517 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b56f2eb-f4ba-4b3a-85e2-3179051373fe" path="/var/lib/kubelet/pods/0b56f2eb-f4ba-4b3a-85e2-3179051373fe/volumes" Jul 29 10:34:00.611500 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:00.611470 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:34:00.614153 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:00.614133 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:34:00.618625 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:00.618608 2517 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 10:34:24.445887 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.445849 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr"] Jul 29 10:34:24.447359 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.446325 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b56f2eb-f4ba-4b3a-85e2-3179051373fe" containerName="console" Jul 29 10:34:24.447359 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.446339 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b56f2eb-f4ba-4b3a-85e2-3179051373fe" containerName="console" Jul 29 10:34:24.447359 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.446425 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b56f2eb-f4ba-4b3a-85e2-3179051373fe" containerName="console" Jul 29 10:34:24.453910 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.453885 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:24.456015 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.455993 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 10:34:24.456283 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.456262 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wwd2r\"" Jul 29 10:34:24.456514 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.456496 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 10:34:24.457294 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.457270 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr"] Jul 29 10:34:24.542342 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.542308 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bffwc\" (UniqueName: \"kubernetes.io/projected/bb0276cd-e8a2-408e-b23f-b60861d9076f-kube-api-access-bffwc\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:24.542472 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.542351 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:24.542472 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.542453 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:24.643796 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.643765 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:24.643933 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.643821 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bffwc\" (UniqueName: \"kubernetes.io/projected/bb0276cd-e8a2-408e-b23f-b60861d9076f-kube-api-access-bffwc\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:24.643933 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.643857 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:24.644201 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.644179 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:24.644271 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.644189 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:24.651258 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.651234 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bffwc\" (UniqueName: \"kubernetes.io/projected/bb0276cd-e8a2-408e-b23f-b60861d9076f-kube-api-access-bffwc\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:24.763528 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.763492 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:24.891631 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.891595 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr"] Jul 29 10:34:24.894721 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:34:24.894666 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb0276cd_e8a2_408e_b23f_b60861d9076f.slice/crio-c8fd582edf0cfeb4b25365c19d72e54372e6982c111f9173eec2f9a3362940ac WatchSource:0}: Error finding container c8fd582edf0cfeb4b25365c19d72e54372e6982c111f9173eec2f9a3362940ac: Status 404 returned error can't find the container with id c8fd582edf0cfeb4b25365c19d72e54372e6982c111f9173eec2f9a3362940ac Jul 29 10:34:24.896715 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:24.896681 2517 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 10:34:25.152958 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:25.152870 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" event={"ID":"bb0276cd-e8a2-408e-b23f-b60861d9076f","Type":"ContainerStarted","Data":"c8fd582edf0cfeb4b25365c19d72e54372e6982c111f9173eec2f9a3362940ac"} Jul 29 10:34:31.183693 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:31.183603 2517 generic.go:356] "Generic (PLEG): container finished" podID="bb0276cd-e8a2-408e-b23f-b60861d9076f" containerID="d8c8b2681bea51f8ba4f10cdcdc8274e2f011ede7afec145d63f08564a53a484" exitCode=0 Jul 29 10:34:31.183693 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:31.183659 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" event={"ID":"bb0276cd-e8a2-408e-b23f-b60861d9076f","Type":"ContainerDied","Data":"d8c8b2681bea51f8ba4f10cdcdc8274e2f011ede7afec145d63f08564a53a484"} Jul 29 10:34:48.250769 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:48.250733 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" event={"ID":"bb0276cd-e8a2-408e-b23f-b60861d9076f","Type":"ContainerStarted","Data":"1ee6f830398e9d3d6f8f613845f0b94baa44a7ab8dfbe976a240499736da2022"} Jul 29 10:34:49.256197 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:49.256160 2517 generic.go:356] "Generic (PLEG): container finished" podID="bb0276cd-e8a2-408e-b23f-b60861d9076f" containerID="1ee6f830398e9d3d6f8f613845f0b94baa44a7ab8dfbe976a240499736da2022" exitCode=0 Jul 29 10:34:49.256570 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:49.256214 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" event={"ID":"bb0276cd-e8a2-408e-b23f-b60861d9076f","Type":"ContainerDied","Data":"1ee6f830398e9d3d6f8f613845f0b94baa44a7ab8dfbe976a240499736da2022"} Jul 29 10:34:55.289251 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:55.289174 2517 generic.go:356] "Generic (PLEG): container finished" podID="bb0276cd-e8a2-408e-b23f-b60861d9076f" containerID="ffbac22af8b0c4949a6b7343bc3efa70f74f4c8664cbba5ad0c6bee81747e145" exitCode=0 Jul 29 10:34:55.289251 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:55.289234 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" event={"ID":"bb0276cd-e8a2-408e-b23f-b60861d9076f","Type":"ContainerDied","Data":"ffbac22af8b0c4949a6b7343bc3efa70f74f4c8664cbba5ad0c6bee81747e145"} Jul 29 10:34:56.414111 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:56.414091 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:56.598670 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:56.598591 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-util\") pod \"bb0276cd-e8a2-408e-b23f-b60861d9076f\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " Jul 29 10:34:56.598670 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:56.598643 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-bundle\") pod \"bb0276cd-e8a2-408e-b23f-b60861d9076f\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " Jul 29 10:34:56.598859 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:56.598692 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bffwc\" (UniqueName: \"kubernetes.io/projected/bb0276cd-e8a2-408e-b23f-b60861d9076f-kube-api-access-bffwc\") pod \"bb0276cd-e8a2-408e-b23f-b60861d9076f\" (UID: \"bb0276cd-e8a2-408e-b23f-b60861d9076f\") " Jul 29 10:34:56.599293 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:56.599260 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-bundle" (OuterVolumeSpecName: "bundle") pod "bb0276cd-e8a2-408e-b23f-b60861d9076f" (UID: "bb0276cd-e8a2-408e-b23f-b60861d9076f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:34:56.600881 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:56.600846 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb0276cd-e8a2-408e-b23f-b60861d9076f-kube-api-access-bffwc" (OuterVolumeSpecName: "kube-api-access-bffwc") pod "bb0276cd-e8a2-408e-b23f-b60861d9076f" (UID: "bb0276cd-e8a2-408e-b23f-b60861d9076f"). InnerVolumeSpecName "kube-api-access-bffwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:34:56.603578 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:56.603558 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-util" (OuterVolumeSpecName: "util") pod "bb0276cd-e8a2-408e-b23f-b60861d9076f" (UID: "bb0276cd-e8a2-408e-b23f-b60861d9076f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:34:56.699198 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:56.699176 2517 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-bundle\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:34:56.699299 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:56.699209 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bffwc\" (UniqueName: \"kubernetes.io/projected/bb0276cd-e8a2-408e-b23f-b60861d9076f-kube-api-access-bffwc\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:34:56.699299 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:56.699219 2517 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb0276cd-e8a2-408e-b23f-b60861d9076f-util\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:34:57.299173 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:57.299139 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" event={"ID":"bb0276cd-e8a2-408e-b23f-b60861d9076f","Type":"ContainerDied","Data":"c8fd582edf0cfeb4b25365c19d72e54372e6982c111f9173eec2f9a3362940ac"} Jul 29 10:34:57.299173 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:57.299156 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5d2tcr" Jul 29 10:34:57.299370 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:34:57.299187 2517 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8fd582edf0cfeb4b25365c19d72e54372e6982c111f9173eec2f9a3362940ac" Jul 29 10:35:23.899107 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.899073 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d"] Jul 29 10:35:23.899456 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.899369 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0276cd-e8a2-408e-b23f-b60861d9076f" containerName="pull" Jul 29 10:35:23.899456 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.899380 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0276cd-e8a2-408e-b23f-b60861d9076f" containerName="pull" Jul 29 10:35:23.899456 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.899391 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0276cd-e8a2-408e-b23f-b60861d9076f" containerName="util" Jul 29 10:35:23.899456 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.899397 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0276cd-e8a2-408e-b23f-b60861d9076f" containerName="util" Jul 29 10:35:23.899456 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.899403 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0276cd-e8a2-408e-b23f-b60861d9076f" containerName="extract" Jul 29 10:35:23.899456 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.899408 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0276cd-e8a2-408e-b23f-b60861d9076f" containerName="extract" Jul 29 10:35:23.899639 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.899466 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb0276cd-e8a2-408e-b23f-b60861d9076f" containerName="extract" Jul 29 10:35:23.901335 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.901316 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:23.903118 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.903097 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 29 10:35:23.903118 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.903110 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-x5b5q\"" Jul 29 10:35:23.903513 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.903497 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 29 10:35:23.903564 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.903543 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 29 10:35:23.903564 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.903552 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 29 10:35:23.903647 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.903546 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 29 10:35:23.910064 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:23.910044 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d"] Jul 29 10:35:24.008003 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.007973 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp7mz\" (UniqueName: \"kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-kube-api-access-wp7mz\") pod \"keda-metrics-apiserver-55557df8c-cdm4d\" (UID: \"c385ff88-90b8-41c6-a28b-4ff946343e0e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:24.008003 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.008003 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-certificates\") pod \"keda-metrics-apiserver-55557df8c-cdm4d\" (UID: \"c385ff88-90b8-41c6-a28b-4ff946343e0e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:24.008157 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.008039 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/c385ff88-90b8-41c6-a28b-4ff946343e0e-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-cdm4d\" (UID: \"c385ff88-90b8-41c6-a28b-4ff946343e0e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:24.108416 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.108376 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp7mz\" (UniqueName: \"kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-kube-api-access-wp7mz\") pod \"keda-metrics-apiserver-55557df8c-cdm4d\" (UID: \"c385ff88-90b8-41c6-a28b-4ff946343e0e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:24.108416 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.108411 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-certificates\") pod \"keda-metrics-apiserver-55557df8c-cdm4d\" (UID: \"c385ff88-90b8-41c6-a28b-4ff946343e0e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:24.108621 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.108444 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/c385ff88-90b8-41c6-a28b-4ff946343e0e-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-cdm4d\" (UID: \"c385ff88-90b8-41c6-a28b-4ff946343e0e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:24.108621 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:35:24.108542 2517 secret.go:281] references non-existent secret key: tls.crt Jul 29 10:35:24.108621 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:35:24.108563 2517 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 29 10:35:24.108621 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:35:24.108578 2517 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d: references non-existent secret key: tls.crt Jul 29 10:35:24.108842 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:35:24.108643 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-certificates podName:c385ff88-90b8-41c6-a28b-4ff946343e0e nodeName:}" failed. No retries permitted until 2026-07-29 10:35:24.608626183 +0000 UTC m=+384.358524805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-certificates") pod "keda-metrics-apiserver-55557df8c-cdm4d" (UID: "c385ff88-90b8-41c6-a28b-4ff946343e0e") : references non-existent secret key: tls.crt Jul 29 10:35:24.108842 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.108771 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/c385ff88-90b8-41c6-a28b-4ff946343e0e-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-cdm4d\" (UID: \"c385ff88-90b8-41c6-a28b-4ff946343e0e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:24.118361 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.118339 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp7mz\" (UniqueName: \"kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-kube-api-access-wp7mz\") pod \"keda-metrics-apiserver-55557df8c-cdm4d\" (UID: \"c385ff88-90b8-41c6-a28b-4ff946343e0e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:24.611388 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.611355 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-certificates\") pod \"keda-metrics-apiserver-55557df8c-cdm4d\" (UID: \"c385ff88-90b8-41c6-a28b-4ff946343e0e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:24.611553 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:35:24.611514 2517 secret.go:281] references non-existent secret key: tls.crt Jul 29 10:35:24.611553 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:35:24.611534 2517 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 29 10:35:24.611553 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:35:24.611551 2517 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d: references non-existent secret key: tls.crt Jul 29 10:35:24.611657 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:35:24.611614 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-certificates podName:c385ff88-90b8-41c6-a28b-4ff946343e0e nodeName:}" failed. No retries permitted until 2026-07-29 10:35:25.611600176 +0000 UTC m=+385.361498787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-certificates") pod "keda-metrics-apiserver-55557df8c-cdm4d" (UID: "c385ff88-90b8-41c6-a28b-4ff946343e0e") : references non-existent secret key: tls.crt Jul 29 10:35:24.670679 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.670647 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-9p8ct"] Jul 29 10:35:24.675918 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.675897 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" Jul 29 10:35:24.677452 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.677435 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 29 10:35:24.683160 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.683135 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-9p8ct"] Jul 29 10:35:24.813272 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.813242 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/28f42f1b-adc7-4731-beb8-41499dce8cda-certificates\") pod \"keda-admission-56f9798bb4-9p8ct\" (UID: \"28f42f1b-adc7-4731-beb8-41499dce8cda\") " pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" Jul 29 10:35:24.813386 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.813282 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4swl\" (UniqueName: \"kubernetes.io/projected/28f42f1b-adc7-4731-beb8-41499dce8cda-kube-api-access-h4swl\") pod \"keda-admission-56f9798bb4-9p8ct\" (UID: \"28f42f1b-adc7-4731-beb8-41499dce8cda\") " pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" Jul 29 10:35:24.914383 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.914318 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/28f42f1b-adc7-4731-beb8-41499dce8cda-certificates\") pod \"keda-admission-56f9798bb4-9p8ct\" (UID: \"28f42f1b-adc7-4731-beb8-41499dce8cda\") " pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" Jul 29 10:35:24.914383 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.914358 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4swl\" (UniqueName: \"kubernetes.io/projected/28f42f1b-adc7-4731-beb8-41499dce8cda-kube-api-access-h4swl\") pod \"keda-admission-56f9798bb4-9p8ct\" (UID: \"28f42f1b-adc7-4731-beb8-41499dce8cda\") " pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" Jul 29 10:35:24.914755 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:35:24.914463 2517 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 29 10:35:24.914755 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:35:24.914487 2517 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-9p8ct: secret "keda-admission-webhooks-certs" not found Jul 29 10:35:24.914755 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:35:24.914536 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28f42f1b-adc7-4731-beb8-41499dce8cda-certificates podName:28f42f1b-adc7-4731-beb8-41499dce8cda nodeName:}" failed. No retries permitted until 2026-07-29 10:35:25.414521874 +0000 UTC m=+385.164420486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/28f42f1b-adc7-4731-beb8-41499dce8cda-certificates") pod "keda-admission-56f9798bb4-9p8ct" (UID: "28f42f1b-adc7-4731-beb8-41499dce8cda") : secret "keda-admission-webhooks-certs" not found Jul 29 10:35:24.922739 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:24.922695 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4swl\" (UniqueName: \"kubernetes.io/projected/28f42f1b-adc7-4731-beb8-41499dce8cda-kube-api-access-h4swl\") pod \"keda-admission-56f9798bb4-9p8ct\" (UID: \"28f42f1b-adc7-4731-beb8-41499dce8cda\") " pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" Jul 29 10:35:25.418920 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:25.418888 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/28f42f1b-adc7-4731-beb8-41499dce8cda-certificates\") pod \"keda-admission-56f9798bb4-9p8ct\" (UID: \"28f42f1b-adc7-4731-beb8-41499dce8cda\") " pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" Jul 29 10:35:25.421218 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:25.421191 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/28f42f1b-adc7-4731-beb8-41499dce8cda-certificates\") pod \"keda-admission-56f9798bb4-9p8ct\" (UID: \"28f42f1b-adc7-4731-beb8-41499dce8cda\") " pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" Jul 29 10:35:25.587743 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:25.587692 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" Jul 29 10:35:25.620815 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:25.620593 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-certificates\") pod \"keda-metrics-apiserver-55557df8c-cdm4d\" (UID: \"c385ff88-90b8-41c6-a28b-4ff946343e0e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:25.622941 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:25.622914 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c385ff88-90b8-41c6-a28b-4ff946343e0e-certificates\") pod \"keda-metrics-apiserver-55557df8c-cdm4d\" (UID: \"c385ff88-90b8-41c6-a28b-4ff946343e0e\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:25.713104 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:25.713072 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:25.753659 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:25.753636 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-9p8ct"] Jul 29 10:35:25.755361 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:35:25.755334 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f42f1b_adc7_4731_beb8_41499dce8cda.slice/crio-c996bc2e12a4d9664e59dbc904decc34c09b6e8b9923d04419919d22a0109ac7 WatchSource:0}: Error finding container c996bc2e12a4d9664e59dbc904decc34c09b6e8b9923d04419919d22a0109ac7: Status 404 returned error can't find the container with id c996bc2e12a4d9664e59dbc904decc34c09b6e8b9923d04419919d22a0109ac7 Jul 29 10:35:25.856035 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:25.856008 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d"] Jul 29 10:35:25.859377 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:35:25.859352 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc385ff88_90b8_41c6_a28b_4ff946343e0e.slice/crio-947156eec22baba6ec8043e905e4e15c18f398171a331a22a048053f6a13fe50 WatchSource:0}: Error finding container 947156eec22baba6ec8043e905e4e15c18f398171a331a22a048053f6a13fe50: Status 404 returned error can't find the container with id 947156eec22baba6ec8043e905e4e15c18f398171a331a22a048053f6a13fe50 Jul 29 10:35:26.415898 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:26.415857 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" event={"ID":"c385ff88-90b8-41c6-a28b-4ff946343e0e","Type":"ContainerStarted","Data":"947156eec22baba6ec8043e905e4e15c18f398171a331a22a048053f6a13fe50"} Jul 29 10:35:26.416972 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:26.416946 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" event={"ID":"28f42f1b-adc7-4731-beb8-41499dce8cda","Type":"ContainerStarted","Data":"c996bc2e12a4d9664e59dbc904decc34c09b6e8b9923d04419919d22a0109ac7"} Jul 29 10:35:29.432103 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:29.432062 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" event={"ID":"c385ff88-90b8-41c6-a28b-4ff946343e0e","Type":"ContainerStarted","Data":"83db886872ea7b8fb90dc9fa426e4807845698a30a1856b40b8adbf9a08024e5"} Jul 29 10:35:29.432505 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:29.432205 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:29.450520 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:29.450477 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" podStartSLOduration=3.555800418 podStartE2EDuration="6.450463222s" totalImagesPullingTime="2.894662804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:35:29.447502878 +0000 UTC m=+389.197401514" watchObservedRunningTime="2026-07-29 10:35:29.450463222 +0000 UTC m=+389.200361856" Jul 29 10:35:40.440602 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:40.440525 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-cdm4d" Jul 29 10:35:40.478775 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:40.478738 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" event={"ID":"28f42f1b-adc7-4731-beb8-41499dce8cda","Type":"ContainerStarted","Data":"a8933ffd967f29923620436fa310f6468efb716e15d07e0b9924c6591a106a7b"} Jul 29 10:35:40.478942 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:40.478810 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" Jul 29 10:35:40.498156 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:40.498106 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" podStartSLOduration=2.288147992 podStartE2EDuration="16.498092099s" totalImagesPullingTime="14.209944107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:35:40.496867393 +0000 UTC m=+400.246766040" watchObservedRunningTime="2026-07-29 10:35:40.498092099 +0000 UTC m=+400.247990730" Jul 29 10:35:51.204785 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.204754 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65884c8677-7mwwm"] Jul 29 10:35:51.207369 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.207341 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.220083 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.220059 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65884c8677-7mwwm"] Jul 29 10:35:51.313647 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.313619 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-oauth-serving-cert\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.313791 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.313650 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cb8e596-2569-45ba-922c-f0ebcc942ffb-console-serving-cert\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.313791 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.313670 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-service-ca\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.313791 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.313715 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-trusted-ca-bundle\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.313791 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.313743 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cb8e596-2569-45ba-922c-f0ebcc942ffb-console-oauth-config\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.313791 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.313765 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-console-config\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.313960 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.313834 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vfjd\" (UniqueName: \"kubernetes.io/projected/5cb8e596-2569-45ba-922c-f0ebcc942ffb-kube-api-access-7vfjd\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.414381 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.414359 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cb8e596-2569-45ba-922c-f0ebcc942ffb-console-serving-cert\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.414492 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.414389 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-service-ca\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.414492 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.414413 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-trusted-ca-bundle\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.414492 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.414436 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cb8e596-2569-45ba-922c-f0ebcc942ffb-console-oauth-config\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.414492 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.414471 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-console-config\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.414663 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.414516 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vfjd\" (UniqueName: \"kubernetes.io/projected/5cb8e596-2569-45ba-922c-f0ebcc942ffb-kube-api-access-7vfjd\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.414663 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.414559 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-oauth-serving-cert\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.415243 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.415215 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-service-ca\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.415379 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.415362 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-oauth-serving-cert\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.415453 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.415419 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-console-config\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.415513 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.415466 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb8e596-2569-45ba-922c-f0ebcc942ffb-trusted-ca-bundle\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.417011 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.416989 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cb8e596-2569-45ba-922c-f0ebcc942ffb-console-serving-cert\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.417185 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.417165 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cb8e596-2569-45ba-922c-f0ebcc942ffb-console-oauth-config\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.421142 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.421123 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vfjd\" (UniqueName: \"kubernetes.io/projected/5cb8e596-2569-45ba-922c-f0ebcc942ffb-kube-api-access-7vfjd\") pod \"console-65884c8677-7mwwm\" (UID: \"5cb8e596-2569-45ba-922c-f0ebcc942ffb\") " pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.516382 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.516322 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:35:51.645595 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:51.645570 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65884c8677-7mwwm"] Jul 29 10:35:51.648044 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:35:51.648017 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb8e596_2569_45ba_922c_f0ebcc942ffb.slice/crio-a943ff388c1ab24a379f922fb7103bc12bf446b26d746b8cca38d187f2d567ed WatchSource:0}: Error finding container a943ff388c1ab24a379f922fb7103bc12bf446b26d746b8cca38d187f2d567ed: Status 404 returned error can't find the container with id a943ff388c1ab24a379f922fb7103bc12bf446b26d746b8cca38d187f2d567ed Jul 29 10:35:52.528869 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:52.528832 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65884c8677-7mwwm" event={"ID":"5cb8e596-2569-45ba-922c-f0ebcc942ffb","Type":"ContainerStarted","Data":"8887aefa92fc84d8d1dec1c33472c4c00dd4d7a00785891660002a0d4a1c3e0f"} Jul 29 10:35:52.529242 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:52.528913 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65884c8677-7mwwm" event={"ID":"5cb8e596-2569-45ba-922c-f0ebcc942ffb","Type":"ContainerStarted","Data":"a943ff388c1ab24a379f922fb7103bc12bf446b26d746b8cca38d187f2d567ed"} Jul 29 10:35:52.546820 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:35:52.546773 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65884c8677-7mwwm" podStartSLOduration=1.546758904 podStartE2EDuration="1.546758904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:35:52.545817073 +0000 UTC m=+412.295715718" watchObservedRunningTime="2026-07-29 10:35:52.546758904 +0000 UTC m=+412.296657581" Jul 29 10:36:01.485211 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:01.485170 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-9p8ct" Jul 29 10:36:01.516903 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:01.516820 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:36:01.516903 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:01.516871 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:36:01.521684 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:01.521666 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:36:01.570819 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:01.570798 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65884c8677-7mwwm" Jul 29 10:36:01.622999 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:01.622962 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ff8654496-9kb59"] Jul 29 10:36:26.648007 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.647903 2517 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5ff8654496-9kb59" podUID="67cbc502-4f05-41c6-a9ce-a9d7958c2996" containerName="console" containerID="cri-o://aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5" gracePeriod=15 Jul 29 10:36:26.890641 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.890615 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:36:26.969802 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.969778 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-oauth-serving-cert\") pod \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " Jul 29 10:36:26.969917 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.969821 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-oauth-config\") pod \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " Jul 29 10:36:26.969917 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.969838 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbsm5\" (UniqueName: \"kubernetes.io/projected/67cbc502-4f05-41c6-a9ce-a9d7958c2996-kube-api-access-vbsm5\") pod \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " Jul 29 10:36:26.969917 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.969864 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-serving-cert\") pod \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " Jul 29 10:36:26.969917 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.969893 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-config\") pod \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " Jul 29 10:36:26.970114 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.969922 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-service-ca\") pod \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " Jul 29 10:36:26.970114 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.969944 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-trusted-ca-bundle\") pod \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\" (UID: \"67cbc502-4f05-41c6-a9ce-a9d7958c2996\") " Jul 29 10:36:26.970473 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.970406 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-service-ca" (OuterVolumeSpecName: "service-ca") pod "67cbc502-4f05-41c6-a9ce-a9d7958c2996" (UID: "67cbc502-4f05-41c6-a9ce-a9d7958c2996"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:36:26.970473 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.970432 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "67cbc502-4f05-41c6-a9ce-a9d7958c2996" (UID: "67cbc502-4f05-41c6-a9ce-a9d7958c2996"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:36:26.970473 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.970451 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-config" (OuterVolumeSpecName: "console-config") pod "67cbc502-4f05-41c6-a9ce-a9d7958c2996" (UID: "67cbc502-4f05-41c6-a9ce-a9d7958c2996"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:36:26.970648 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.970581 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "67cbc502-4f05-41c6-a9ce-a9d7958c2996" (UID: "67cbc502-4f05-41c6-a9ce-a9d7958c2996"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:36:26.971964 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.971944 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "67cbc502-4f05-41c6-a9ce-a9d7958c2996" (UID: "67cbc502-4f05-41c6-a9ce-a9d7958c2996"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:36:26.972027 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.971994 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67cbc502-4f05-41c6-a9ce-a9d7958c2996-kube-api-access-vbsm5" (OuterVolumeSpecName: "kube-api-access-vbsm5") pod "67cbc502-4f05-41c6-a9ce-a9d7958c2996" (UID: "67cbc502-4f05-41c6-a9ce-a9d7958c2996"). InnerVolumeSpecName "kube-api-access-vbsm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:36:26.972066 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:26.972042 2517 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "67cbc502-4f05-41c6-a9ce-a9d7958c2996" (UID: "67cbc502-4f05-41c6-a9ce-a9d7958c2996"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:36:27.071383 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.071348 2517 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-service-ca\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:36:27.071383 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.071381 2517 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-trusted-ca-bundle\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:36:27.071526 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.071396 2517 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-oauth-serving-cert\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:36:27.071526 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.071409 2517 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-oauth-config\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:36:27.071526 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.071422 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbsm5\" (UniqueName: \"kubernetes.io/projected/67cbc502-4f05-41c6-a9ce-a9d7958c2996-kube-api-access-vbsm5\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:36:27.071526 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.071435 2517 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-serving-cert\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:36:27.071526 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.071447 2517 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67cbc502-4f05-41c6-a9ce-a9d7958c2996-console-config\") on node \"ip-10-0-138-43.ec2.internal\" DevicePath \"\"" Jul 29 10:36:27.683176 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.683143 2517 generic.go:356] "Generic (PLEG): container finished" podID="67cbc502-4f05-41c6-a9ce-a9d7958c2996" containerID="aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5" exitCode=0 Jul 29 10:36:27.683545 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.683189 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ff8654496-9kb59" Jul 29 10:36:27.683545 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.683224 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ff8654496-9kb59" event={"ID":"67cbc502-4f05-41c6-a9ce-a9d7958c2996","Type":"ContainerDied","Data":"aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5"} Jul 29 10:36:27.683545 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.683275 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ff8654496-9kb59" event={"ID":"67cbc502-4f05-41c6-a9ce-a9d7958c2996","Type":"ContainerDied","Data":"257a535b6e4082cb3706255a12c529d2735e022ab9b5f8a08985b2bd77b3cc64"} Jul 29 10:36:27.683545 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.683298 2517 scope.go:117] "RemoveContainer" containerID="aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5" Jul 29 10:36:27.692425 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.692411 2517 scope.go:117] "RemoveContainer" containerID="aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5" Jul 29 10:36:27.692673 ip-10-0-138-43 kubenswrapper[2517]: E0729 10:36:27.692655 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5\": container with ID starting with aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5 not found: ID does not exist" containerID="aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5" Jul 29 10:36:27.692746 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.692681 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5"} err="failed to get container status \"aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5\": rpc error: code = NotFound desc = could not find container \"aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5\": container with ID starting with aa00679015992ef960875c19168c4dc4d0cfb9a51fe24cce7c0f74887965c0a5 not found: ID does not exist" Jul 29 10:36:27.703885 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.703866 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ff8654496-9kb59"] Jul 29 10:36:27.708347 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:27.708325 2517 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ff8654496-9kb59"] Jul 29 10:36:28.768677 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:28.768645 2517 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67cbc502-4f05-41c6-a9ce-a9d7958c2996" path="/var/lib/kubelet/pods/67cbc502-4f05-41c6-a9ce-a9d7958c2996/volumes" Jul 29 10:36:40.437153 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.437122 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-zbvw2"] Jul 29 10:36:40.437529 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.437465 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67cbc502-4f05-41c6-a9ce-a9d7958c2996" containerName="console" Jul 29 10:36:40.437529 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.437478 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="67cbc502-4f05-41c6-a9ce-a9d7958c2996" containerName="console" Jul 29 10:36:40.437601 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.437552 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="67cbc502-4f05-41c6-a9ce-a9d7958c2996" containerName="console" Jul 29 10:36:40.442127 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.442107 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" Jul 29 10:36:40.444197 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.444169 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 29 10:36:40.444327 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.444214 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 29 10:36:40.444327 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.444175 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 29 10:36:40.444327 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.444264 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-khtd6\"" Jul 29 10:36:40.455774 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.455755 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-zbvw2"] Jul 29 10:36:40.463077 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.463048 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-998q6\" (UniqueName: \"kubernetes.io/projected/d478a256-c869-46b9-a121-e7c5db7ac26d-kube-api-access-998q6\") pod \"llmisvc-controller-manager-84fc959947-zbvw2\" (UID: \"d478a256-c869-46b9-a121-e7c5db7ac26d\") " pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" Jul 29 10:36:40.463198 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.463142 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d478a256-c869-46b9-a121-e7c5db7ac26d-cert\") pod \"llmisvc-controller-manager-84fc959947-zbvw2\" (UID: \"d478a256-c869-46b9-a121-e7c5db7ac26d\") " pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" Jul 29 10:36:40.469239 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.469218 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-jm2xt"] Jul 29 10:36:40.472350 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.472328 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-jm2xt" Jul 29 10:36:40.474403 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.474383 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 29 10:36:40.474403 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.474398 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-bxbkh\"" Jul 29 10:36:40.483000 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.482971 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-jm2xt"] Jul 29 10:36:40.563711 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.563677 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d478a256-c869-46b9-a121-e7c5db7ac26d-cert\") pod \"llmisvc-controller-manager-84fc959947-zbvw2\" (UID: \"d478a256-c869-46b9-a121-e7c5db7ac26d\") " pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" Jul 29 10:36:40.563895 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.563767 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4a73d2a3-5060-4c47-be3c-5a2bc041672c-data\") pod \"seaweedfs-64568bcd49-jm2xt\" (UID: \"4a73d2a3-5060-4c47-be3c-5a2bc041672c\") " pod="kserve/seaweedfs-64568bcd49-jm2xt" Jul 29 10:36:40.563895 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.563807 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-998q6\" (UniqueName: \"kubernetes.io/projected/d478a256-c869-46b9-a121-e7c5db7ac26d-kube-api-access-998q6\") pod \"llmisvc-controller-manager-84fc959947-zbvw2\" (UID: \"d478a256-c869-46b9-a121-e7c5db7ac26d\") " pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" Jul 29 10:36:40.563986 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.563896 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8vk7\" (UniqueName: \"kubernetes.io/projected/4a73d2a3-5060-4c47-be3c-5a2bc041672c-kube-api-access-x8vk7\") pod \"seaweedfs-64568bcd49-jm2xt\" (UID: \"4a73d2a3-5060-4c47-be3c-5a2bc041672c\") " pod="kserve/seaweedfs-64568bcd49-jm2xt" Jul 29 10:36:40.565992 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.565968 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d478a256-c869-46b9-a121-e7c5db7ac26d-cert\") pod \"llmisvc-controller-manager-84fc959947-zbvw2\" (UID: \"d478a256-c869-46b9-a121-e7c5db7ac26d\") " pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" Jul 29 10:36:40.570956 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.570930 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-998q6\" (UniqueName: \"kubernetes.io/projected/d478a256-c869-46b9-a121-e7c5db7ac26d-kube-api-access-998q6\") pod \"llmisvc-controller-manager-84fc959947-zbvw2\" (UID: \"d478a256-c869-46b9-a121-e7c5db7ac26d\") " pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" Jul 29 10:36:40.664936 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.664904 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4a73d2a3-5060-4c47-be3c-5a2bc041672c-data\") pod \"seaweedfs-64568bcd49-jm2xt\" (UID: \"4a73d2a3-5060-4c47-be3c-5a2bc041672c\") " pod="kserve/seaweedfs-64568bcd49-jm2xt" Jul 29 10:36:40.665057 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.664958 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8vk7\" (UniqueName: \"kubernetes.io/projected/4a73d2a3-5060-4c47-be3c-5a2bc041672c-kube-api-access-x8vk7\") pod \"seaweedfs-64568bcd49-jm2xt\" (UID: \"4a73d2a3-5060-4c47-be3c-5a2bc041672c\") " pod="kserve/seaweedfs-64568bcd49-jm2xt" Jul 29 10:36:40.665271 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.665252 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4a73d2a3-5060-4c47-be3c-5a2bc041672c-data\") pod \"seaweedfs-64568bcd49-jm2xt\" (UID: \"4a73d2a3-5060-4c47-be3c-5a2bc041672c\") " pod="kserve/seaweedfs-64568bcd49-jm2xt" Jul 29 10:36:40.673647 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.673617 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8vk7\" (UniqueName: \"kubernetes.io/projected/4a73d2a3-5060-4c47-be3c-5a2bc041672c-kube-api-access-x8vk7\") pod \"seaweedfs-64568bcd49-jm2xt\" (UID: \"4a73d2a3-5060-4c47-be3c-5a2bc041672c\") " pod="kserve/seaweedfs-64568bcd49-jm2xt" Jul 29 10:36:40.753526 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.753498 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" Jul 29 10:36:40.781361 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.781334 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-jm2xt" Jul 29 10:36:40.897794 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.897729 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-zbvw2"] Jul 29 10:36:40.901296 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:36:40.901266 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd478a256_c869_46b9_a121_e7c5db7ac26d.slice/crio-337ca87020a586c12051d2d0e6ccdfb91343df7bc1e2d4fdd800026cfec6f2a8 WatchSource:0}: Error finding container 337ca87020a586c12051d2d0e6ccdfb91343df7bc1e2d4fdd800026cfec6f2a8: Status 404 returned error can't find the container with id 337ca87020a586c12051d2d0e6ccdfb91343df7bc1e2d4fdd800026cfec6f2a8 Jul 29 10:36:40.923348 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:40.923325 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-jm2xt"] Jul 29 10:36:40.925554 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:36:40.925529 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a73d2a3_5060_4c47_be3c_5a2bc041672c.slice/crio-cca4a4d036e29b0b367a0fdcddc8fa828d8bb91bd89c52346b49a6572d6a650f WatchSource:0}: Error finding container cca4a4d036e29b0b367a0fdcddc8fa828d8bb91bd89c52346b49a6572d6a650f: Status 404 returned error can't find the container with id cca4a4d036e29b0b367a0fdcddc8fa828d8bb91bd89c52346b49a6572d6a650f Jul 29 10:36:41.744820 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:41.744693 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" event={"ID":"d478a256-c869-46b9-a121-e7c5db7ac26d","Type":"ContainerStarted","Data":"337ca87020a586c12051d2d0e6ccdfb91343df7bc1e2d4fdd800026cfec6f2a8"} Jul 29 10:36:41.747147 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:41.747078 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-jm2xt" event={"ID":"4a73d2a3-5060-4c47-be3c-5a2bc041672c","Type":"ContainerStarted","Data":"cca4a4d036e29b0b367a0fdcddc8fa828d8bb91bd89c52346b49a6572d6a650f"} Jul 29 10:36:44.770126 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:44.770100 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" Jul 29 10:36:44.770486 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:44.770153 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" event={"ID":"d478a256-c869-46b9-a121-e7c5db7ac26d","Type":"ContainerStarted","Data":"470e5fbbeb93bd66adb10a5729f289b93e6e631bf48058b84cf479aa0d486b63"} Jul 29 10:36:44.770486 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:44.770176 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-jm2xt" Jul 29 10:36:44.770486 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:44.770190 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-jm2xt" event={"ID":"4a73d2a3-5060-4c47-be3c-5a2bc041672c","Type":"ContainerStarted","Data":"d527c2b6c79bdd1ea92f0b25012ed14e2a55e6b0362d3209f7ba5c9cc165916a"} Jul 29 10:36:44.783913 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:44.783862 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" podStartSLOduration=1.059573817 podStartE2EDuration="4.783848053s" totalImagesPullingTime="3.724274236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:36:44.78180384 +0000 UTC m=+464.531702475" watchObservedRunningTime="2026-07-29 10:36:44.783848053 +0000 UTC m=+464.533746686" Jul 29 10:36:44.795454 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:44.795309 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-jm2xt" podStartSLOduration=1.043911868 podStartE2EDuration="4.795257657s" totalImagesPullingTime="3.751345789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:36:44.795154504 +0000 UTC m=+464.545053136" watchObservedRunningTime="2026-07-29 10:36:44.795257657 +0000 UTC m=+464.545156293" Jul 29 10:36:50.775058 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:36:50.775027 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-jm2xt" Jul 29 10:37:15.774878 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:15.774844 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-84fc959947-zbvw2" Jul 29 10:37:58.314142 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.314068 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-xphln"] Jul 29 10:37:58.317575 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.317555 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-xphln" Jul 29 10:37:58.319319 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.319299 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 29 10:37:58.319406 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.319324 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-tb4pr\"" Jul 29 10:37:58.327648 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.327624 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-xphln"] Jul 29 10:37:58.388555 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.388530 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e8be6b4-2492-4b36-8578-0d302c3a9285-cert\") pod \"odh-model-controller-75d9cdbddf-xphln\" (UID: \"0e8be6b4-2492-4b36-8578-0d302c3a9285\") " pod="kserve/odh-model-controller-75d9cdbddf-xphln" Jul 29 10:37:58.388654 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.388568 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtdxk\" (UniqueName: \"kubernetes.io/projected/0e8be6b4-2492-4b36-8578-0d302c3a9285-kube-api-access-wtdxk\") pod \"odh-model-controller-75d9cdbddf-xphln\" (UID: \"0e8be6b4-2492-4b36-8578-0d302c3a9285\") " pod="kserve/odh-model-controller-75d9cdbddf-xphln" Jul 29 10:37:58.489462 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.489435 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e8be6b4-2492-4b36-8578-0d302c3a9285-cert\") pod \"odh-model-controller-75d9cdbddf-xphln\" (UID: \"0e8be6b4-2492-4b36-8578-0d302c3a9285\") " pod="kserve/odh-model-controller-75d9cdbddf-xphln" Jul 29 10:37:58.489552 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.489475 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtdxk\" (UniqueName: \"kubernetes.io/projected/0e8be6b4-2492-4b36-8578-0d302c3a9285-kube-api-access-wtdxk\") pod \"odh-model-controller-75d9cdbddf-xphln\" (UID: \"0e8be6b4-2492-4b36-8578-0d302c3a9285\") " pod="kserve/odh-model-controller-75d9cdbddf-xphln" Jul 29 10:37:58.491913 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.491894 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e8be6b4-2492-4b36-8578-0d302c3a9285-cert\") pod \"odh-model-controller-75d9cdbddf-xphln\" (UID: \"0e8be6b4-2492-4b36-8578-0d302c3a9285\") " pod="kserve/odh-model-controller-75d9cdbddf-xphln" Jul 29 10:37:58.497560 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.497538 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtdxk\" (UniqueName: \"kubernetes.io/projected/0e8be6b4-2492-4b36-8578-0d302c3a9285-kube-api-access-wtdxk\") pod \"odh-model-controller-75d9cdbddf-xphln\" (UID: \"0e8be6b4-2492-4b36-8578-0d302c3a9285\") " pod="kserve/odh-model-controller-75d9cdbddf-xphln" Jul 29 10:37:58.629298 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.629234 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-xphln" Jul 29 10:37:58.757356 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:58.757331 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-xphln"] Jul 29 10:37:58.760014 ip-10-0-138-43 kubenswrapper[2517]: W0729 10:37:58.759989 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8be6b4_2492_4b36_8578_0d302c3a9285.slice/crio-dca624e07501ee39ab73b1074cac60c1a7e3eb365bb8ef9d202c1892b248694a WatchSource:0}: Error finding container dca624e07501ee39ab73b1074cac60c1a7e3eb365bb8ef9d202c1892b248694a: Status 404 returned error can't find the container with id dca624e07501ee39ab73b1074cac60c1a7e3eb365bb8ef9d202c1892b248694a Jul 29 10:37:59.074578 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:37:59.074546 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-xphln" event={"ID":"0e8be6b4-2492-4b36-8578-0d302c3a9285","Type":"ContainerStarted","Data":"dca624e07501ee39ab73b1074cac60c1a7e3eb365bb8ef9d202c1892b248694a"} Jul 29 10:38:02.093013 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:38:02.092975 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-xphln" event={"ID":"0e8be6b4-2492-4b36-8578-0d302c3a9285","Type":"ContainerStarted","Data":"d6ff2d35929970db3fab06387610c0efe1ba853b99ff77cfdac87fdf0caf29e7"} Jul 29 10:38:02.093381 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:38:02.093070 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-75d9cdbddf-xphln" Jul 29 10:38:02.112016 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:38:02.111974 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-75d9cdbddf-xphln" podStartSLOduration=1.59700252 podStartE2EDuration="4.111961571s" totalImagesPullingTime="2.514959051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:38:02.11096386 +0000 UTC m=+541.860862507" watchObservedRunningTime="2026-07-29 10:38:02.111961571 +0000 UTC m=+541.861860205" Jul 29 10:38:13.099967 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:38:13.099939 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-75d9cdbddf-xphln" Jul 29 10:39:00.647572 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:39:00.647546 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:39:00.648001 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:39:00.647545 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:44:00.673312 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:44:00.673238 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:44:00.676309 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:44:00.676289 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:49:00.701717 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:49:00.701604 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:49:00.705280 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:49:00.705254 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:54:00.737824 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:54:00.737790 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:54:00.740327 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:54:00.740306 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:59:00.766307 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:59:00.766281 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 10:59:00.769366 ip-10-0-138-43 kubenswrapper[2517]: I0729 10:59:00.769345 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 11:04:00.796957 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:04:00.796925 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 11:04:00.801716 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:04:00.801686 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 11:05:49.476533 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:49.476503 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-72csv_c606e9e5-8010-44dc-9a0e-8d4656eb495a/global-pull-secret-syncer/0.log" Jul 29 11:05:49.670505 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:49.670475 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gxscm_0983da81-073a-4164-baf4-f710b75e71a7/konnectivity-agent/0.log" Jul 29 11:05:49.749524 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:49.749453 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-43.ec2.internal_2dd5713812e824284c4e3f717a7001f2/haproxy/0.log" Jul 29 11:05:54.135201 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.135166 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae2cddb-9a16-4541-8670-b396d7eec4fa/alertmanager/0.log" Jul 29 11:05:54.159647 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.159622 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae2cddb-9a16-4541-8670-b396d7eec4fa/config-reloader/0.log" Jul 29 11:05:54.182427 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.182405 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae2cddb-9a16-4541-8670-b396d7eec4fa/kube-rbac-proxy-web/0.log" Jul 29 11:05:54.200455 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.200430 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae2cddb-9a16-4541-8670-b396d7eec4fa/kube-rbac-proxy/0.log" Jul 29 11:05:54.221777 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.221754 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae2cddb-9a16-4541-8670-b396d7eec4fa/kube-rbac-proxy-metric/0.log" Jul 29 11:05:54.243989 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.243967 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae2cddb-9a16-4541-8670-b396d7eec4fa/prom-label-proxy/0.log" Jul 29 11:05:54.261203 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.261182 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae2cddb-9a16-4541-8670-b396d7eec4fa/init-config-reloader/0.log" Jul 29 11:05:54.299014 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.298987 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-86klv_17d49008-e794-4257-bead-a90128ff8b2c/cluster-monitoring-operator/0.log" Jul 29 11:05:54.321302 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.321275 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-hxf8v_2d6bdb39-2ce4-428e-92f6-cf00d9002e04/kube-state-metrics/0.log" Jul 29 11:05:54.342824 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.342799 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-hxf8v_2d6bdb39-2ce4-428e-92f6-cf00d9002e04/kube-rbac-proxy-main/0.log" Jul 29 11:05:54.374382 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.374361 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-hxf8v_2d6bdb39-2ce4-428e-92f6-cf00d9002e04/kube-rbac-proxy-self/0.log" Jul 29 11:05:54.620880 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.620854 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mfd2c_91ffc8ca-36a5-41a3-886f-735aff042078/node-exporter/0.log" Jul 29 11:05:54.642098 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.642068 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mfd2c_91ffc8ca-36a5-41a3-886f-735aff042078/kube-rbac-proxy/0.log" Jul 29 11:05:54.659386 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.659361 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mfd2c_91ffc8ca-36a5-41a3-886f-735aff042078/init-textfile/0.log" Jul 29 11:05:54.684104 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.684082 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-kjhzt_927d047f-2a6d-4743-83a9-9e3142a9e221/kube-rbac-proxy-main/0.log" Jul 29 11:05:54.709052 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.709029 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-kjhzt_927d047f-2a6d-4743-83a9-9e3142a9e221/kube-rbac-proxy-self/0.log" Jul 29 11:05:54.727733 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.727694 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-kjhzt_927d047f-2a6d-4743-83a9-9e3142a9e221/openshift-state-metrics/0.log" Jul 29 11:05:54.960819 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.960787 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-67glj_c6692f4d-a4f4-4f9b-a6ac-e34936567391/prometheus-operator-admission-webhook/0.log" Jul 29 11:05:54.987361 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:54.987331 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84f855f498-fjxnx_754389d2-e463-48b4-8149-6c87132c18cd/telemeter-client/0.log" Jul 29 11:05:55.009574 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:55.009546 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84f855f498-fjxnx_754389d2-e463-48b4-8149-6c87132c18cd/reload/0.log" Jul 29 11:05:55.030686 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:55.030660 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84f855f498-fjxnx_754389d2-e463-48b4-8149-6c87132c18cd/kube-rbac-proxy/0.log" Jul 29 11:05:55.066073 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:55.066048 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffc76c4-gmmd2_47b31d24-8ec0-4cc0-8c92-d2596d9b49fc/thanos-query/0.log" Jul 29 11:05:55.097196 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:55.097171 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffc76c4-gmmd2_47b31d24-8ec0-4cc0-8c92-d2596d9b49fc/kube-rbac-proxy-web/0.log" Jul 29 11:05:55.125892 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:55.125869 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffc76c4-gmmd2_47b31d24-8ec0-4cc0-8c92-d2596d9b49fc/kube-rbac-proxy/0.log" Jul 29 11:05:55.156539 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:55.156509 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffc76c4-gmmd2_47b31d24-8ec0-4cc0-8c92-d2596d9b49fc/prom-label-proxy/0.log" Jul 29 11:05:55.189220 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:55.189190 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffc76c4-gmmd2_47b31d24-8ec0-4cc0-8c92-d2596d9b49fc/kube-rbac-proxy-rules/0.log" Jul 29 11:05:55.227876 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:55.227817 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffc76c4-gmmd2_47b31d24-8ec0-4cc0-8c92-d2596d9b49fc/kube-rbac-proxy-metrics/0.log" Jul 29 11:05:56.471043 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:56.471011 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-w54dt_41b34f49-8333-49eb-a1f1-ef9caca2088a/networking-console-plugin/0.log" Jul 29 11:05:57.316348 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:57.316323 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65884c8677-7mwwm_5cb8e596-2569-45ba-922c-f0ebcc942ffb/console/0.log" Jul 29 11:05:58.353000 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.352965 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww"] Jul 29 11:05:58.356662 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.356638 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.358612 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.358591 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mxlpr\"/\"kube-root-ca.crt\"" Jul 29 11:05:58.358740 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.358685 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mxlpr\"/\"default-dockercfg-dc47v\"" Jul 29 11:05:58.359111 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.359088 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mxlpr\"/\"openshift-service-ca.crt\"" Jul 29 11:05:58.365187 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.365165 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww"] Jul 29 11:05:58.405088 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.405050 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-proc\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.405256 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.405100 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-lib-modules\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.405256 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.405175 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-sys\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.405256 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.405231 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njqjd\" (UniqueName: \"kubernetes.io/projected/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-kube-api-access-njqjd\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.405403 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.405276 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-podres\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.505689 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.505646 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njqjd\" (UniqueName: \"kubernetes.io/projected/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-kube-api-access-njqjd\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.505689 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.505693 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-podres\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.505911 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.505762 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-proc\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.505911 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.505780 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-lib-modules\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.505911 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.505813 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-sys\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.505911 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.505830 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-podres\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.505911 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.505886 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-proc\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.505911 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.505914 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-lib-modules\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.506133 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.505968 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-sys\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.514309 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.514275 2517 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njqjd\" (UniqueName: \"kubernetes.io/projected/260dd21d-2b77-4f12-a8a4-ff46d596ef3b-kube-api-access-njqjd\") pod \"perf-node-gather-daemonset-qwzww\" (UID: \"260dd21d-2b77-4f12-a8a4-ff46d596ef3b\") " pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.667798 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.667685 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:58.713502 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.713473 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vq7d_c3a8551b-8b94-462f-acc1-09f58220aa32/dns/0.log" Jul 29 11:05:58.732793 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.732730 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vq7d_c3a8551b-8b94-462f-acc1-09f58220aa32/kube-rbac-proxy/0.log" Jul 29 11:05:58.801978 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.801954 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww"] Jul 29 11:05:58.804012 ip-10-0-138-43 kubenswrapper[2517]: W0729 11:05:58.803982 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod260dd21d_2b77_4f12_a8a4_ff46d596ef3b.slice/crio-e878cfae37edf4694d9b567c7f392720f587aaf4e5f8f909f5490243913984c5 WatchSource:0}: Error finding container e878cfae37edf4694d9b567c7f392720f587aaf4e5f8f909f5490243913984c5: Status 404 returned error can't find the container with id e878cfae37edf4694d9b567c7f392720f587aaf4e5f8f909f5490243913984c5 Jul 29 11:05:58.841064 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:58.841043 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7rkjp_73554e56-a2c1-4012-b7af-425b2f86ba7c/dns-node-resolver/0.log" Jul 29 11:05:59.294631 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:59.294600 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54f49b87dc-wzxbl_7f2933ca-2f84-4e11-a89e-1a2af191b1e4/registry/0.log" Jul 29 11:05:59.361066 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:59.361038 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-shzv5_098abb85-fffa-4b88-a3c4-965f8b699caf/node-ca/0.log" Jul 29 11:05:59.709288 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:59.709254 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" event={"ID":"260dd21d-2b77-4f12-a8a4-ff46d596ef3b","Type":"ContainerStarted","Data":"db15a43d47aaf56409363bdb5dfdeca441738efc30f5a66a5a2e03509c666098"} Jul 29 11:05:59.709493 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:59.709309 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" event={"ID":"260dd21d-2b77-4f12-a8a4-ff46d596ef3b","Type":"ContainerStarted","Data":"e878cfae37edf4694d9b567c7f392720f587aaf4e5f8f909f5490243913984c5"} Jul 29 11:05:59.709493 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:59.709356 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:05:59.724429 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:05:59.724383 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" podStartSLOduration=1.7243689359999999 podStartE2EDuration="1.724368936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 11:05:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 11:05:59.722545235 +0000 UTC m=+2219.472443879" watchObservedRunningTime="2026-07-29 11:05:59.724368936 +0000 UTC m=+2219.474267570" Jul 29 11:06:00.036066 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:00.035996 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f8d744b6c-jpktk_d0f32a8b-9dcb-4a91-86e2-ee8f1f0fb394/router/0.log" Jul 29 11:06:00.362361 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:00.362284 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v6wqm_8ef268b1-5b59-4dae-950b-8695dd350841/serve-healthcheck-canary/0.log" Jul 29 11:06:00.808150 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:00.808119 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s87xx_600142b1-f705-415e-a041-0c46996966e4/kube-rbac-proxy/0.log" Jul 29 11:06:00.824048 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:00.824023 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s87xx_600142b1-f705-415e-a041-0c46996966e4/exporter/0.log" Jul 29 11:06:00.840365 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:00.840346 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s87xx_600142b1-f705-415e-a041-0c46996966e4/extractor/0.log" Jul 29 11:06:03.014368 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:03.014339 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-84fc959947-zbvw2_d478a256-c869-46b9-a121-e7c5db7ac26d/manager/0.log" Jul 29 11:06:03.127792 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:03.127758 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-75d9cdbddf-xphln_0e8be6b4-2492-4b36-8578-0d302c3a9285/manager/0.log" Jul 29 11:06:03.205271 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:03.205242 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-jm2xt_4a73d2a3-5060-4c47-be3c-5a2bc041672c/seaweedfs/0.log" Jul 29 11:06:05.726966 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:05.726934 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mxlpr/perf-node-gather-daemonset-qwzww" Jul 29 11:06:08.177931 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:08.177896 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k6gbl_f162015f-478c-442a-a3c7-f85f6eefc4fa/kube-multus-additional-cni-plugins/0.log" Jul 29 11:06:08.202770 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:08.202742 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k6gbl_f162015f-478c-442a-a3c7-f85f6eefc4fa/egress-router-binary-copy/0.log" Jul 29 11:06:08.226064 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:08.226042 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k6gbl_f162015f-478c-442a-a3c7-f85f6eefc4fa/cni-plugins/0.log" Jul 29 11:06:08.245735 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:08.245712 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k6gbl_f162015f-478c-442a-a3c7-f85f6eefc4fa/bond-cni-plugin/0.log" Jul 29 11:06:08.268873 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:08.268849 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k6gbl_f162015f-478c-442a-a3c7-f85f6eefc4fa/routeoverride-cni/0.log" Jul 29 11:06:08.287376 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:08.287357 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k6gbl_f162015f-478c-442a-a3c7-f85f6eefc4fa/whereabouts-cni-bincopy/0.log" Jul 29 11:06:08.308006 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:08.307988 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k6gbl_f162015f-478c-442a-a3c7-f85f6eefc4fa/whereabouts-cni/0.log" Jul 29 11:06:08.616976 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:08.616945 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s2wcl_2813a209-455f-4de6-9786-a7977764c26b/kube-multus/0.log" Jul 29 11:06:08.668424 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:08.668396 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hpzsh_3b2b8b47-f121-4b15-8595-7152e2d10091/network-metrics-daemon/0.log" Jul 29 11:06:08.683735 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:08.683712 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hpzsh_3b2b8b47-f121-4b15-8595-7152e2d10091/kube-rbac-proxy/0.log" Jul 29 11:06:09.931753 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:09.931722 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-controller/0.log" Jul 29 11:06:09.946319 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:09.946294 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/1.log" Jul 29 11:06:09.946449 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:09.946309 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovn-acl-logging/0.log" Jul 29 11:06:09.963108 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:09.963086 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/kube-rbac-proxy-node/0.log" Jul 29 11:06:09.980528 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:09.980500 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 11:06:09.996464 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:09.996444 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/northd/0.log" Jul 29 11:06:10.020603 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:10.020581 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/nbdb/0.log" Jul 29 11:06:10.034641 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:10.034624 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/sbdb/0.log" Jul 29 11:06:10.070853 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:10.070829 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7g4l_d7c33fe7-5b31-459b-bede-8164c9bec386/ovnkube-controller/0.log" Jul 29 11:06:11.042441 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:11.042410 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mrgw4_e7963bf2-2e04-413b-b2f7-38f3bf858b53/network-check-target-container/0.log" Jul 29 11:06:12.031777 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:12.031750 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6lkk9_79bb5c4a-327b-4369-8efb-2cd798838aae/iptables-alerter/0.log" Jul 29 11:06:12.683333 ip-10-0-138-43 kubenswrapper[2517]: I0729 11:06:12.683301 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qv2zf_dc2bb501-1b1d-494d-b3e2-e4c0062e5793/tuned/0.log"