Jul 09 07:00:14.688322 ip-10-0-137-118 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 07:00:14.688332 ip-10-0-137-118 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 07:00:14.688341 ip-10-0-137-118 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 07:00:14.688771 ip-10-0-137-118 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 07:00:24.867184 ip-10-0-137-118 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 07:00:24.867200 ip-10-0-137-118 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1cd2c11503714088ad6479d412c1d21a -- Jul 09 07:02:23.873021 ip-10-0-137-118 systemd[1]: Starting Kubernetes Kubelet... Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.266687 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274771 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274784 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274788 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274792 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274795 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274798 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274801 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 07:02:24.294423 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274803 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274806 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274809 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274812 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274826 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274828 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274831 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274834 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274837 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274840 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274843 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274846 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274848 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274851 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274854 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274857 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274859 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274862 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274865 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274867 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 07:02:24.295706 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274870 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274873 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274875 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274879 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274881 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274884 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274886 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274889 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274891 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274894 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274896 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274899 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274910 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274913 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274915 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274918 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274920 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274928 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274933 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 07:02:24.296597 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274937 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274941 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274943 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274947 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274950 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274953 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274955 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274958 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274961 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274963 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274966 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274968 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274971 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274973 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274976 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274979 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274982 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274985 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274987 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274990 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 07:02:24.297449 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274992 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274995 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.274997 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275000 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275002 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275005 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275007 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275011 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275015 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275017 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275021 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275029 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275032 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275035 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275038 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275042 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275046 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275048 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275051 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 07:02:24.298311 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275055 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275059 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275061 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275064 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275066 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275069 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275072 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275075 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275077 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275080 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275082 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275085 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275087 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275090 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275964 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275972 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275975 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275978 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275982 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275984 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 07:02:24.299200 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275987 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275989 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275992 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275995 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.275998 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276007 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276009 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276012 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276021 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276025 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276028 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276030 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276033 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276036 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276038 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276040 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276043 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276046 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276048 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276051 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 07:02:24.300080 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276055 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276059 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276062 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276064 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276068 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276070 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276074 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276077 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276080 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276083 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276086 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276090 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276093 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276096 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276100 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276102 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276105 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276108 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276119 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 07:02:24.300961 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276122 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276125 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276128 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276131 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276133 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276136 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276138 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276141 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276143 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276146 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276148 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276151 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276154 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276157 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276159 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276162 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276166 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276169 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276172 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 07:02:24.302055 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276174 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276177 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276181 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276184 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276186 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276189 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276191 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276193 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276196 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276198 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276201 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276203 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276205 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276215 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276218 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276220 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276223 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276225 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276228 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276231 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 07:02:24.302940 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276234 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276236 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276238 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276241 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276243 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276246 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276248 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276251 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276253 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276255 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276258 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276261 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276263 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276266 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276269 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276711 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276715 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276718 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276721 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276724 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 07:02:24.303836 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276727 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276729 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276745 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276748 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276751 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276759 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276762 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276765 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276768 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276771 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276773 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276776 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276778 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276783 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276786 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276788 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276791 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276793 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276796 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276799 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 07:02:24.304724 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276802 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276804 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276807 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276810 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276812 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276815 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276817 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276820 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276822 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276825 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276829 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276831 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276834 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276837 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276839 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276841 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276844 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276846 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276855 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 07:02:24.305648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276857 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276862 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276865 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276868 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276871 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276874 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276879 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276881 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276885 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276888 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276892 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276896 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276899 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276901 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276904 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276906 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276909 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276912 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276914 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 07:02:24.306537 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276916 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276919 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276921 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276924 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276927 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276930 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276932 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276936 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276938 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276941 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276943 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276946 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276948 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276957 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276960 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276962 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276965 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276967 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276969 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276973 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 07:02:24.307433 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276976 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276978 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276981 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276983 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276985 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276988 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276991 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276993 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276995 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.276998 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277000 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277003 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277006 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277008 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277010 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277013 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277091 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277101 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277117 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277124 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277129 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 07:02:24.308323 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277132 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277136 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277140 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277143 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277146 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277156 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277160 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277163 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277166 2565 flags.go:64] FLAG: --cgroup-root="" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277168 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277174 2565 flags.go:64] FLAG: --client-ca-file="" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277177 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277180 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277188 2565 flags.go:64] FLAG: --cluster-domain="" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277191 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277194 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277197 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277201 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277204 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277207 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277211 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277214 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277217 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277220 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 07:02:24.309221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277223 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277226 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277229 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277234 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277237 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277240 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277243 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277246 2565 flags.go:64] FLAG: --enable-server="true" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277249 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277255 2565 flags.go:64] FLAG: --event-burst="100" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277259 2565 flags.go:64] FLAG: --event-qps="50" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277262 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277265 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277267 2565 flags.go:64] FLAG: --eviction-hard="" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277277 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277280 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277282 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277285 2565 flags.go:64] FLAG: --eviction-soft="" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277289 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277292 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277295 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277298 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277301 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277304 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277306 2565 flags.go:64] FLAG: --feature-gates="" Jul 09 07:02:24.310359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277310 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277313 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277316 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277320 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277323 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277326 2565 flags.go:64] FLAG: --help="false" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277328 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277331 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277334 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277337 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277342 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277345 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277348 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277351 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277353 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277356 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277359 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277362 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277364 2565 flags.go:64] FLAG: --kube-reserved="" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277367 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277370 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277373 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277381 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277384 2565 flags.go:64] FLAG: --lock-file="" Jul 09 07:02:24.314677 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277387 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277391 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277394 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277399 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277402 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277405 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277408 2565 flags.go:64] FLAG: --logging-format="text" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277410 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277413 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277416 2565 flags.go:64] FLAG: --manifest-url="" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277419 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277424 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277426 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277430 2565 flags.go:64] FLAG: --max-pods="110" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277433 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277436 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277439 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277442 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277449 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277452 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277455 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277462 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277465 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277468 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 07:02:24.315993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277471 2565 flags.go:64] FLAG: --pod-cidr="" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277474 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277479 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277482 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277485 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277487 2565 flags.go:64] FLAG: --port="10250" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277490 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277499 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-009486898ab38f68b" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277502 2565 flags.go:64] FLAG: --qos-reserved="" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277507 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277509 2565 flags.go:64] FLAG: --register-node="true" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277512 2565 flags.go:64] FLAG: --register-with-taints="" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277516 2565 flags.go:64] FLAG: --registry-burst="10" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277519 2565 flags.go:64] FLAG: --registry-qps="5" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277522 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277525 2565 flags.go:64] FLAG: --reserved-memory="" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277528 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277531 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277534 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277537 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277540 2565 flags.go:64] FLAG: --runonce="false" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277543 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277546 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277549 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277551 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 07:02:24.442203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277554 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 07:02:24.353391 ip-10-0-137-118 systemd[1]: Started Kubernetes Kubelet. Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277558 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277562 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277565 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277567 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277570 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277573 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277576 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277579 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277582 2565 flags.go:64] FLAG: --system-cgroups="" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277584 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277596 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277599 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277602 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277609 2565 flags.go:64] FLAG: --tls-min-version="" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277620 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277624 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277627 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277630 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277633 2565 flags.go:64] FLAG: --v="2" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277637 2565 flags.go:64] FLAG: --version="false" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277642 2565 flags.go:64] FLAG: --vmodule="" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277645 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.277648 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277823 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 07:02:24.443576 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277827 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277830 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277833 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277836 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277839 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277841 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277843 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277846 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277849 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277853 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277856 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277858 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277861 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277863 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277866 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277868 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277871 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277873 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277876 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277879 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 07:02:24.445079 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277881 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277884 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277886 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277896 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277899 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277901 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277904 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277906 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277909 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277911 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277914 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277917 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277919 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277922 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277924 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277926 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277929 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277931 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277934 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 07:02:24.446127 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277936 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277940 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277945 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277948 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277950 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277953 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277956 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277958 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277960 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277963 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277965 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277968 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277970 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277973 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277975 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277978 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277984 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277993 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277996 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 07:02:24.447195 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.277999 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278002 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278005 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278008 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278010 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278013 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278015 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278018 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278021 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278023 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278026 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278028 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278030 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278033 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278036 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278039 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278042 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278045 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278047 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278050 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 07:02:24.448284 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278052 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278055 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278057 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278060 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278062 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278065 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278067 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278070 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278072 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278077 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278079 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278089 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278093 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278096 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278100 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278102 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278105 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278108 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278111 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 07:02:24.449357 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.278114 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.278717 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.291306 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.291323 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.292527 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.292535 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292595 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292600 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292603 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292607 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292610 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292612 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292615 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292619 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292622 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 07:02:24.450490 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292624 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292627 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292629 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292632 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292634 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292637 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292639 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292642 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292645 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292647 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292651 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292655 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292657 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292660 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292663 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292666 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292669 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292672 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292675 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292677 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 07:02:24.451346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292680 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292683 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292686 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292688 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292691 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292693 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292696 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292698 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292701 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292703 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292706 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292708 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292711 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292713 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292717 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292721 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292724 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292727 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292743 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 07:02:24.452439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292748 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292752 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292754 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292758 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292761 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292763 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292767 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292769 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292772 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292778 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292781 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292784 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292786 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292789 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292792 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292794 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292797 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292800 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292802 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292805 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 07:02:24.453291 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292807 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292810 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292812 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292815 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292818 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292820 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292823 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292826 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292830 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292833 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292836 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292840 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292843 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292848 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292851 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292854 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292856 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292859 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292862 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292864 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 07:02:24.454356 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292867 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292871 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292874 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292877 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292880 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292883 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292886 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292888 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292891 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292894 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.292897 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.292902 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293020 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293026 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293030 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 07:02:24.455445 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293034 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293037 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293040 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293042 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293046 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293048 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293051 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293053 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293056 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293061 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293066 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293069 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293071 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293074 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293077 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293080 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293082 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293085 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293087 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293091 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 07:02:24.456249 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293094 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293097 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293099 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293102 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293105 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293107 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293110 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293112 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293115 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293117 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293120 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293123 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293125 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293128 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293130 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293133 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293135 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293138 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293141 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 07:02:24.457135 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293143 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293145 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293148 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293153 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293155 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293158 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293160 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293163 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293166 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293168 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293171 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293173 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293177 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293179 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293182 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293184 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293187 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293189 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293192 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 07:02:24.458007 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293195 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293197 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293200 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293202 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293205 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293207 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293210 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293212 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293215 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293217 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293220 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293222 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293225 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293227 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293229 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293232 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293235 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293239 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293242 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293245 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 07:02:24.459078 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293249 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293252 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293254 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293257 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293260 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293264 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293267 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293270 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293272 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293275 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293277 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293280 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293282 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293285 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293287 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293290 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293292 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 07:02:24.459942 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:24.293295 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.293300 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.293422 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.295605 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.297155 2565 server.go:1019] "Starting client certificate rotation" Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.297261 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.297293 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.299846 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.302711 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.317777 2565 log.go:25] "Validated CRI v1 runtime API" Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.320116 2565 log.go:25] "Validated CRI v1 image API" Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.321833 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 07:02:24.460994 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.324170 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 f35a7eae-18c8-4dd6-a611-3626789177d9:/dev/nvme0n1p4 fcceddbb-14b7-4043-af07-1d1d5e07fd8d:/dev/nvme0n1p3] Jul 09 07:02:24.463377 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.324195 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 07:02:24.463377 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.328435 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.332008 2565 manager.go:216] Machine: {Timestamp:2026-07-09 07:02:24.330410866 +0000 UTC m=+0.334082491 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101358 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec263376b5ce4140c0cc1b92e36b1d07 SystemUUID:ec263376-b5ce-4140-c0cc-1b92e36b1d07 BootID:1cd2c115-0371-4088-ad64-79d412c1d21a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b3:d8:d7:c5:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b3:d8:d7:c5:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:da:26:49:cd:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.333529 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.334214 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.337301 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.337328 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.338009 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.338018 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.338026 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.338709 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.339812 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.342677 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.342860 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.342890 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.342900 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.342914 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.342923 2565 kubelet.go:398] "Adding apiserver pod source" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.342932 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 07:02:24.485795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.343388 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.343410 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.345669 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.347413 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.347441 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348548 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348563 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348568 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348574 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348582 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348588 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348584 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hb7zt" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348596 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348602 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348610 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348618 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348632 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.348643 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.349401 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.349411 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.352569 2565 server.go:1268] "Started kubelet" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.352985 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.352967 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.354873 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.354948 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.355036 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.355108 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.355334 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.355913 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hb7zt" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.356687 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.360077 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.360471 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-118.ec2.internal.18c08d0e266e6e53 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-118.ec2.internal,UID:ip-10-0-137-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-118.ec2.internal,},FirstTimestamp:2026-07-09 07:02:24.352546387 +0000 UTC m=+0.356218013,LastTimestamp:2026-07-09 07:02:24.352546387 +0000 UTC m=+0.356218013,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-118.ec2.internal,}" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.362425 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.362435 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.362592 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363256 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363271 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363255 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363370 2565 factory.go:55] Registering systemd factory Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363403 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 09 07:02:24.487234 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363410 2565 factory.go:223] Registration of the systemd container factory successfully Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363412 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363631 2565 factory.go:153] Registering CRI-O factory Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363644 2565 factory.go:223] Registration of the crio container factory successfully Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363691 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363712 2565 factory.go:103] Registering Raw factory Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.363723 2565 manager.go:1196] Started watching for new ooms in manager Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.364356 2565 manager.go:349] Starting recovery of all containers Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.365530 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.371361 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-118.ec2.internal\" not found" node="ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.380492 2565 manager.go:354] Recovery completed Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.387968 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.389758 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientMemory" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.389786 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.389796 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientPID" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.390302 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.390313 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.390318 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.390333 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.391052 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientMemory" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.391075 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.391085 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientPID" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.391515 2565 policy_none.go:49] "None policy: Start" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.391527 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.391537 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.392515 2565 policy_none.go:47] "Start" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.438361 2565 manager.go:337] "Starting Device Plugin manager" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.438558 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.438571 2565 server.go:87] "Starting device plugin registration server" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.438933 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.438944 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.439044 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.439140 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.439149 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.439645 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 07:02:24.488390 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.439700 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.518844 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.520028 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.520063 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.520099 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.520134 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.522350 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.539258 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.540116 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientMemory" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.540138 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.540149 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientPID" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.540170 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.547854 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.547873 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-118.ec2.internal\": node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.560565 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.620853 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-118.ec2.internal"] Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.620947 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.621930 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientMemory" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.621960 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.621974 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientPID" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.623239 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.623355 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.623387 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.623949 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientMemory" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.623976 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.623988 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientPID" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.623951 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientMemory" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.624058 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.624069 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientPID" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.627249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.627272 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.627963 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientMemory" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.627994 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.628011 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeHasSufficientPID" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.653601 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-118.ec2.internal\" not found" node="ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.657912 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-118.ec2.internal\" not found" node="ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.660948 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:24.676276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.668293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc853c8f2f1ea6a968532ff9703fcfa8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal\" (UID: \"cc853c8f2f1ea6a968532ff9703fcfa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.678538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.668315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc853c8f2f1ea6a968532ff9703fcfa8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal\" (UID: \"cc853c8f2f1ea6a968532ff9703fcfa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.678538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.668333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e23d70a312ac711b759fd35bb366a792-config\") pod \"kube-apiserver-proxy-ip-10-0-137-118.ec2.internal\" (UID: \"e23d70a312ac711b759fd35bb366a792\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.876833 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.761976 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:24.876833 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.769311 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc853c8f2f1ea6a968532ff9703fcfa8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal\" (UID: \"cc853c8f2f1ea6a968532ff9703fcfa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.876833 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.769336 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc853c8f2f1ea6a968532ff9703fcfa8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal\" (UID: \"cc853c8f2f1ea6a968532ff9703fcfa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.876833 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.769355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e23d70a312ac711b759fd35bb366a792-config\") pod \"kube-apiserver-proxy-ip-10-0-137-118.ec2.internal\" (UID: \"e23d70a312ac711b759fd35bb366a792\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.876833 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.769383 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e23d70a312ac711b759fd35bb366a792-config\") pod \"kube-apiserver-proxy-ip-10-0-137-118.ec2.internal\" (UID: \"e23d70a312ac711b759fd35bb366a792\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.876833 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.769422 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc853c8f2f1ea6a968532ff9703fcfa8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal\" (UID: \"cc853c8f2f1ea6a968532ff9703fcfa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.876833 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.769426 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc853c8f2f1ea6a968532ff9703fcfa8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal\" (UID: \"cc853c8f2f1ea6a968532ff9703fcfa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:24.876833 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.862952 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:25.064383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.962945 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:25.064383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:24.962972 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-118.ec2.internal" Jul 09 07:02:25.064383 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:24.963014 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:25.066575 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:25.066063 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:25.259272 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:25.167213 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:25.440134 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:25.268242 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:25.440134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.296660 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 07:02:25.440134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.296866 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 07:02:25.440134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.296872 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 07:02:25.440134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.360989 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 06:57:25 +0000 UTC" deadline="2028-02-11 10:14:51.029462106 +0000 UTC" Jul 09 07:02:25.440134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.361017 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13971h12m25.66844819s" Jul 09 07:02:25.440134 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:25.368666 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-118.ec2.internal\" not found" Jul 09 07:02:25.440134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.412326 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 07:02:25.606227 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.463794 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:25.606227 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.476358 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 07:02:25.606227 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.478185 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-118.ec2.internal" Jul 09 07:02:25.606227 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.486158 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 07:02:25.606227 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:25.568588 2565 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = creating pod sandbox with name \"k8s_kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal_openshift-machine-config-operator_cc853c8f2f1ea6a968532ff9703fcfa8_0\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" Jul 09 07:02:25.606227 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:25.568656 2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = creating pod sandbox with name \"k8s_kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal_openshift-machine-config-operator_cc853c8f2f1ea6a968532ff9703fcfa8_0\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:25.606227 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:25.568677 2565 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = creating pod sandbox with name \"k8s_kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal_openshift-machine-config-operator_cc853c8f2f1ea6a968532ff9703fcfa8_0\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:25.606227 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:25.568741 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal_openshift-machine-config-operator(cc853c8f2f1ea6a968532ff9703fcfa8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal_openshift-machine-config-operator(cc853c8f2f1ea6a968532ff9703fcfa8)\\\": rpc error: code = Unknown desc = creating pod sandbox with name \\\"k8s_kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal_openshift-machine-config-operator_cc853c8f2f1ea6a968532ff9703fcfa8_0\\\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" podUID="cc853c8f2f1ea6a968532ff9703fcfa8" Jul 09 07:02:25.606227 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:25.601976 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23d70a312ac711b759fd35bb366a792.slice/crio-4cbb1b2ac7776f3e535bf7ac4b40c6508d68800ca51955ca07a4c0efd27f817c WatchSource:0}: Error finding container 4cbb1b2ac7776f3e535bf7ac4b40c6508d68800ca51955ca07a4c0efd27f817c: Status 404 returned error can't find the container with id 4cbb1b2ac7776f3e535bf7ac4b40c6508d68800ca51955ca07a4c0efd27f817c Jul 09 07:02:25.608200 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.607843 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 07:02:26.014083 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:25.811179 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 07:02:26.299430 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.226905 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.344870 2565 apiserver.go:52] "Watching apiserver" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.351028 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.353019 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-r8mss","openshift-dns/node-resolver-j8fml","openshift-image-registry/node-ca-rjps9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal","openshift-multus/multus-additional-cni-plugins-8lc7j","kube-system/global-pull-secret-syncer-xbl78","openshift-multus/multus-dj2jf","openshift-multus/network-metrics-daemon-25zcm","openshift-network-diagnostics/network-check-target-6qdt7","openshift-network-operator/iptables-alerter-phqvs","openshift-ovn-kubernetes/ovnkube-node-cz6gt","kube-system/konnectivity-agent-wn466","kube-system/kube-apiserver-proxy-ip-10-0-137-118.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng"] Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.354806 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-phqvs" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.356106 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.357165 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.357430 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.357536 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.357729 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rjps9" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.357764 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d4ns8\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.358954 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cwxht\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.359202 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.359485 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.359850 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.360055 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.360304 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.360510 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.360792 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.361248 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.361404 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.361489 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qr77n\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.361753 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.363205 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.363963 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.364087 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.364109 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.364462 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rxb24\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.364489 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.364875 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:26.364972 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.366338 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.366714 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 07:02:26.402470 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.366805 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.366894 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:26.366966 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.367140 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.367361 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5nfxj\"" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.367549 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.368668 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:26.368731 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.371755 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j8fml" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.373217 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.374470 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.375604 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-grvzv\"" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.375992 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.376307 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g7ckm\"" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.378792 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.379564 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.388237 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.388900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67470ece-214e-48ca-ac30-6de722911a50-iptables-alerter-script\") pod \"iptables-alerter-phqvs\" (UID: \"67470ece-214e-48ca-ac30-6de722911a50\") " pod="openshift-network-operator/iptables-alerter-phqvs" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.388970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnc4k\" (UniqueName: \"kubernetes.io/projected/67470ece-214e-48ca-ac30-6de722911a50-kube-api-access-gnc4k\") pod \"iptables-alerter-phqvs\" (UID: \"67470ece-214e-48ca-ac30-6de722911a50\") " pod="openshift-network-operator/iptables-alerter-phqvs" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.389010 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-slash\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.389026 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.389047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-device-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.389093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67470ece-214e-48ca-ac30-6de722911a50-host-slash\") pod \"iptables-alerter-phqvs\" (UID: \"67470ece-214e-48ca-ac30-6de722911a50\") " pod="openshift-network-operator/iptables-alerter-phqvs" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.389131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-run-openvswitch\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.407383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.389271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.389309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-socket-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.389346 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.389413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-sys-fs\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz6wd\" (UniqueName: \"kubernetes.io/projected/75ae4545-08fe-4c72-9a2e-c59380e1d96e-kube-api-access-wz6wd\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-run-systemd\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390317 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-var-lib-openvswitch\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-cni-netd\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9343c58f-279a-480c-9946-ba85f0eef08b-ovnkube-config\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390457 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31b9f6a6-e642-410d-8e01-975cace6de3b-dbus\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-run-netns\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-log-socket\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-cni-bin\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390680 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkwf4\" (UniqueName: \"kubernetes.io/projected/60fb5c1d-e3d7-4d4c-b356-58ff313ae286-kube-api-access-tkwf4\") pod \"node-ca-rjps9\" (UID: \"60fb5c1d-e3d7-4d4c-b356-58ff313ae286\") " pod="openshift-image-registry/node-ca-rjps9" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390704 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c42f0c2b-8932-4145-afb2-385537ef8b4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.409134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390796 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-kubelet\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390865 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-etc-openvswitch\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98nbw\" (UniqueName: \"kubernetes.io/projected/9343c58f-279a-480c-9946-ba85f0eef08b-kube-api-access-98nbw\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c42f0c2b-8932-4145-afb2-385537ef8b4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.390967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31b9f6a6-e642-410d-8e01-975cace6de3b-kubelet-config\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391013 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391143 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9343c58f-279a-480c-9946-ba85f0eef08b-env-overrides\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391193 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60fb5c1d-e3d7-4d4c-b356-58ff313ae286-serviceca\") pod \"node-ca-rjps9\" (UID: \"60fb5c1d-e3d7-4d4c-b356-58ff313ae286\") " pod="openshift-image-registry/node-ca-rjps9" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391227 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-systemd-units\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391288 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-registration-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391342 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-os-release\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391379 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c42f0c2b-8932-4145-afb2-385537ef8b4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5qs8\" (UniqueName: \"kubernetes.io/projected/c42f0c2b-8932-4145-afb2-385537ef8b4c-kube-api-access-r5qs8\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.410407 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391668 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-run-ovn\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.391802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-node-log\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.392119 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mzsms\"" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.392290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9343c58f-279a-480c-9946-ba85f0eef08b-ovn-node-metrics-cert\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.392317 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9343c58f-279a-480c-9946-ba85f0eef08b-ovnkube-script-lib\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.392335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60fb5c1d-e3d7-4d4c-b356-58ff313ae286-host\") pod \"node-ca-rjps9\" (UID: \"60fb5c1d-e3d7-4d4c-b356-58ff313ae286\") " pod="openshift-image-registry/node-ca-rjps9" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.392356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-system-cni-dir\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.392408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-cnibin\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.393487 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nlmgs\"" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.393663 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.394058 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.398907 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-684q2" Jul 09 07:02:26.414284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.406860 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-684q2" Jul 09 07:02:26.491835 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.464388 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-768mg\" (UniqueName: \"kubernetes.io/projected/8ec102ca-2f18-441e-bd65-8aaf7a925887-kube-api-access-768mg\") pod \"node-resolver-j8fml\" (UID: \"8ec102ca-2f18-441e-bd65-8aaf7a925887\") " pod="openshift-dns/node-resolver-j8fml" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-system-cni-dir\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-daemon-config\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493138 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-run-openvswitch\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493212 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-sys-fs\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493255 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz6wd\" (UniqueName: \"kubernetes.io/projected/75ae4545-08fe-4c72-9a2e-c59380e1d96e-kube-api-access-wz6wd\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-var-lib-kubelet\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-sysconfig\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493350 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-cni-netd\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493376 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31b9f6a6-e642-410d-8e01-975cace6de3b-dbus\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493402 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b971b01-9e66-4de5-819e-f83aaa6995d6-agent-certs\") pod \"konnectivity-agent-wn466\" (UID: \"5b971b01-9e66-4de5-819e-f83aaa6995d6\") " pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493426 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ec102ca-2f18-441e-bd65-8aaf7a925887-hosts-file\") pod \"node-resolver-j8fml\" (UID: \"8ec102ca-2f18-441e-bd65-8aaf7a925887\") " pod="openshift-dns/node-resolver-j8fml" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95bzr\" (UniqueName: \"kubernetes.io/projected/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-kube-api-access-95bzr\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-run-openvswitch\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493479 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-cni-bin\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.499193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c42f0c2b-8932-4145-afb2-385537ef8b4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493538 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-socket-dir-parent\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-run-multus-certs\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493610 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-run\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493619 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-cni-bin\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-etc-openvswitch\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493659 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-cni-netd\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98nbw\" (UniqueName: \"kubernetes.io/projected/9343c58f-279a-480c-9946-ba85f0eef08b-kube-api-access-98nbw\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c42f0c2b-8932-4145-afb2-385537ef8b4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493726 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31b9f6a6-e642-410d-8e01-975cace6de3b-kubelet-config\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493732 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-sys-fs\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493796 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-etc-openvswitch\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b971b01-9e66-4de5-819e-f83aaa6995d6-konnectivity-ca\") pod \"konnectivity-agent-wn466\" (UID: \"5b971b01-9e66-4de5-819e-f83aaa6995d6\") " pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493818 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31b9f6a6-e642-410d-8e01-975cace6de3b-dbus\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.493870 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31b9f6a6-e642-410d-8e01-975cace6de3b-kubelet-config\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:26.500624 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:26.493912 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:26.493997 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret podName:31b9f6a6-e642-410d-8e01-975cace6de3b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:26.993958432 +0000 UTC m=+2.997630063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret") pod "global-pull-secret-syncer-xbl78" (UID: "31b9f6a6-e642-410d-8e01-975cace6de3b") : object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-sysctl-d\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494084 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ec102ca-2f18-441e-bd65-8aaf7a925887-tmp-dir\") pod \"node-resolver-j8fml\" (UID: \"8ec102ca-2f18-441e-bd65-8aaf7a925887\") " pod="openshift-dns/node-resolver-j8fml" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-run-k8s-cni-cncf-io\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-run-netns\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494197 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c42f0c2b-8932-4145-afb2-385537ef8b4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494232 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-kubernetes\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-lib-modules\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494287 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-tuned\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494319 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-registration-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494346 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-os-release\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c42f0c2b-8932-4145-afb2-385537ef8b4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.501552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-tmp\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-run-ovn\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-node-log\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494438 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-os-release\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494439 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9343c58f-279a-480c-9946-ba85f0eef08b-ovn-node-metrics-cert\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494440 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-registration-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-cnibin\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494484 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-run-ovn\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494494 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-node-log\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-conf-dir\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494534 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-cnibin\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494547 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-sysctl-conf\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67470ece-214e-48ca-ac30-6de722911a50-iptables-alerter-script\") pod \"iptables-alerter-phqvs\" (UID: \"67470ece-214e-48ca-ac30-6de722911a50\") " pod="openshift-network-operator/iptables-alerter-phqvs" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494627 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnc4k\" (UniqueName: \"kubernetes.io/projected/67470ece-214e-48ca-ac30-6de722911a50-kube-api-access-gnc4k\") pod \"iptables-alerter-phqvs\" (UID: \"67470ece-214e-48ca-ac30-6de722911a50\") " pod="openshift-network-operator/iptables-alerter-phqvs" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-slash\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-device-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494707 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-var-lib-kubelet\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.584490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494740 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67470ece-214e-48ca-ac30-6de722911a50-host-slash\") pod \"iptables-alerter-phqvs\" (UID: \"67470ece-214e-48ca-ac30-6de722911a50\") " pod="openshift-network-operator/iptables-alerter-phqvs" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-socket-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494846 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-host\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.494948 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-run-systemd\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495005 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-var-lib-openvswitch\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495006 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-socket-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495108 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9343c58f-279a-480c-9946-ba85f0eef08b-ovnkube-config\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495157 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67470ece-214e-48ca-ac30-6de722911a50-iptables-alerter-script\") pod \"iptables-alerter-phqvs\" (UID: \"67470ece-214e-48ca-ac30-6de722911a50\") " pod="openshift-network-operator/iptables-alerter-phqvs" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495186 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-cni-dir\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495213 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-var-lib-cni-bin\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495230 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-slash\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-var-lib-cni-multus\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-sys\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495285 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75ae4545-08fe-4c72-9a2e-c59380e1d96e-device-dir\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.585593 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495212 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67470ece-214e-48ca-ac30-6de722911a50-host-slash\") pod \"iptables-alerter-phqvs\" (UID: \"67470ece-214e-48ca-ac30-6de722911a50\") " pod="openshift-network-operator/iptables-alerter-phqvs" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-run-netns\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-log-socket\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkwf4\" (UniqueName: \"kubernetes.io/projected/60fb5c1d-e3d7-4d4c-b356-58ff313ae286-kube-api-access-tkwf4\") pod \"node-ca-rjps9\" (UID: \"60fb5c1d-e3d7-4d4c-b356-58ff313ae286\") " pod="openshift-image-registry/node-ca-rjps9" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495366 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-run-systemd\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495403 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-log-socket\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-cni-binary-copy\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-run-netns\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-hostroot\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495488 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-var-lib-openvswitch\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495623 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-etc-kubernetes\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495654 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-modprobe-d\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-kubelet\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495746 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9343c58f-279a-480c-9946-ba85f0eef08b-ovnkube-config\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-cnibin\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.586504 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495776 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-kubelet\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-os-release\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495816 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r7bq\" (UniqueName: \"kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq\") pod \"network-check-target-6qdt7\" (UID: \"bef75bae-f333-40b5-ac37-d89c07c499c0\") " pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g947\" (UniqueName: \"kubernetes.io/projected/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-kube-api-access-6g947\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9343c58f-279a-480c-9946-ba85f0eef08b-env-overrides\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.495986 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60fb5c1d-e3d7-4d4c-b356-58ff313ae286-serviceca\") pod \"node-ca-rjps9\" (UID: \"60fb5c1d-e3d7-4d4c-b356-58ff313ae286\") " pod="openshift-image-registry/node-ca-rjps9" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496099 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-systemd\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-systemd-units\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c42f0c2b-8932-4145-afb2-385537ef8b4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5qs8\" (UniqueName: \"kubernetes.io/projected/c42f0c2b-8932-4145-afb2-385537ef8b4c-kube-api-access-r5qs8\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkpwp\" (UniqueName: \"kubernetes.io/projected/25b6a9e1-c301-4acf-bd85-6611426f243b-kube-api-access-bkpwp\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496225 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9343c58f-279a-480c-9946-ba85f0eef08b-ovnkube-script-lib\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60fb5c1d-e3d7-4d4c-b356-58ff313ae286-host\") pod \"node-ca-rjps9\" (UID: \"60fb5c1d-e3d7-4d4c-b356-58ff313ae286\") " pod="openshift-image-registry/node-ca-rjps9" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496266 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-system-cni-dir\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.587426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496265 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9343c58f-279a-480c-9946-ba85f0eef08b-env-overrides\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496489 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9343c58f-279a-480c-9946-ba85f0eef08b-systemd-units\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496555 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60fb5c1d-e3d7-4d4c-b356-58ff313ae286-serviceca\") pod \"node-ca-rjps9\" (UID: \"60fb5c1d-e3d7-4d4c-b356-58ff313ae286\") " pod="openshift-image-registry/node-ca-rjps9" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60fb5c1d-e3d7-4d4c-b356-58ff313ae286-host\") pod \"node-ca-rjps9\" (UID: \"60fb5c1d-e3d7-4d4c-b356-58ff313ae286\") " pod="openshift-image-registry/node-ca-rjps9" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496681 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c42f0c2b-8932-4145-afb2-385537ef8b4c-system-cni-dir\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496818 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9343c58f-279a-480c-9946-ba85f0eef08b-ovnkube-script-lib\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.496946 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c42f0c2b-8932-4145-afb2-385537ef8b4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.499121 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9343c58f-279a-480c-9946-ba85f0eef08b-ovn-node-metrics-cert\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.504128 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz6wd\" (UniqueName: \"kubernetes.io/projected/75ae4545-08fe-4c72-9a2e-c59380e1d96e-kube-api-access-wz6wd\") pod \"aws-ebs-csi-driver-node-gkgng\" (UID: \"75ae4545-08fe-4c72-9a2e-c59380e1d96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.505327 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98nbw\" (UniqueName: \"kubernetes.io/projected/9343c58f-279a-480c-9946-ba85f0eef08b-kube-api-access-98nbw\") pod \"ovnkube-node-cz6gt\" (UID: \"9343c58f-279a-480c-9946-ba85f0eef08b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.505784 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkwf4\" (UniqueName: \"kubernetes.io/projected/60fb5c1d-e3d7-4d4c-b356-58ff313ae286-kube-api-access-tkwf4\") pod \"node-ca-rjps9\" (UID: \"60fb5c1d-e3d7-4d4c-b356-58ff313ae286\") " pod="openshift-image-registry/node-ca-rjps9" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.505788 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5qs8\" (UniqueName: \"kubernetes.io/projected/c42f0c2b-8932-4145-afb2-385537ef8b4c-kube-api-access-r5qs8\") pod \"multus-additional-cni-plugins-8lc7j\" (UID: \"c42f0c2b-8932-4145-afb2-385537ef8b4c\") " pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.506574 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnc4k\" (UniqueName: \"kubernetes.io/projected/67470ece-214e-48ca-ac30-6de722911a50-kube-api-access-gnc4k\") pod \"iptables-alerter-phqvs\" (UID: \"67470ece-214e-48ca-ac30-6de722911a50\") " pod="openshift-network-operator/iptables-alerter-phqvs" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.527058 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-118.ec2.internal" event={"ID":"e23d70a312ac711b759fd35bb366a792","Type":"ContainerStarted","Data":"4cbb1b2ac7776f3e535bf7ac4b40c6508d68800ca51955ca07a4c0efd27f817c"} Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.527102 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.527416 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:26.543283 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc853c8f2f1ea6a968532ff9703fcfa8.slice/crio-efcc48719474451b535cfdddb11bcf4c650259217e723cffaac96370e734ea92 WatchSource:0}: Error finding container efcc48719474451b535cfdddb11bcf4c650259217e723cffaac96370e734ea92: Status 404 returned error can't find the container with id efcc48719474451b535cfdddb11bcf4c650259217e723cffaac96370e734ea92 Jul 09 07:02:26.588554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.557508 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 07:02:26.597178 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-cni-binary-copy\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.597322 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597190 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-hostroot\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.597322 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-etc-kubernetes\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.597322 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-modprobe-d\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.597322 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-cnibin\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.597322 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-os-release\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.597322 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597302 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-hostroot\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.597616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7bq\" (UniqueName: \"kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq\") pod \"network-check-target-6qdt7\" (UID: \"bef75bae-f333-40b5-ac37-d89c07c499c0\") " pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:26.597616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g947\" (UniqueName: \"kubernetes.io/projected/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-kube-api-access-6g947\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.597616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597401 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-systemd\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.597616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkpwp\" (UniqueName: \"kubernetes.io/projected/25b6a9e1-c301-4acf-bd85-6611426f243b-kube-api-access-bkpwp\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:26.597616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-768mg\" (UniqueName: \"kubernetes.io/projected/8ec102ca-2f18-441e-bd65-8aaf7a925887-kube-api-access-768mg\") pod \"node-resolver-j8fml\" (UID: \"8ec102ca-2f18-441e-bd65-8aaf7a925887\") " pod="openshift-dns/node-resolver-j8fml" Jul 09 07:02:26.597616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-system-cni-dir\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.597616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-daemon-config\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.597616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597517 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-modprobe-d\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.597616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-var-lib-kubelet\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.597616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597585 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-etc-kubernetes\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.597616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-sysconfig\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597649 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b971b01-9e66-4de5-819e-f83aaa6995d6-agent-certs\") pod \"konnectivity-agent-wn466\" (UID: \"5b971b01-9e66-4de5-819e-f83aaa6995d6\") " pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ec102ca-2f18-441e-bd65-8aaf7a925887-hosts-file\") pod \"node-resolver-j8fml\" (UID: \"8ec102ca-2f18-441e-bd65-8aaf7a925887\") " pod="openshift-dns/node-resolver-j8fml" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597702 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95bzr\" (UniqueName: \"kubernetes.io/projected/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-kube-api-access-95bzr\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-os-release\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-socket-dir-parent\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-run-multus-certs\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597822 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-run\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-system-cni-dir\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b971b01-9e66-4de5-819e-f83aaa6995d6-konnectivity-ca\") pod \"konnectivity-agent-wn466\" (UID: \"5b971b01-9e66-4de5-819e-f83aaa6995d6\") " pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597906 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597915 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-run\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-sysctl-d\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597964 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-sysconfig\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597942 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-systemd\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ec102ca-2f18-441e-bd65-8aaf7a925887-tmp-dir\") pod \"node-resolver-j8fml\" (UID: \"8ec102ca-2f18-441e-bd65-8aaf7a925887\") " pod="openshift-dns/node-resolver-j8fml" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-run-k8s-cni-cncf-io\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-run-netns\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.598173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-kubernetes\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598079 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-lib-modules\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-tuned\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-tmp\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598162 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-conf-dir\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-sysctl-conf\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-var-lib-kubelet\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598226 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-kubernetes\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-host\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598252 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ec102ca-2f18-441e-bd65-8aaf7a925887-tmp-dir\") pod \"node-resolver-j8fml\" (UID: \"8ec102ca-2f18-441e-bd65-8aaf7a925887\") " pod="openshift-dns/node-resolver-j8fml" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-socket-dir-parent\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-host\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597617 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-cnibin\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598330 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-run-multus-certs\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598362 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-cni-dir\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598371 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-run-k8s-cni-cncf-io\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598388 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-daemon-config\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598494 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-lib-modules\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-sysctl-conf\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598536 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-run-netns\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598579 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-var-lib-kubelet\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.597651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-var-lib-kubelet\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-cni-dir\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598757 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-multus-conf-dir\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598766 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-var-lib-cni-bin\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598832 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-var-lib-cni-multus\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598861 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-sys\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598897 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-sysctl-d\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598938 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-sys\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.598983 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-var-lib-cni-bin\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:26.598991 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.599023 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-host-var-lib-cni-multus\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:26.599059 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs podName:25b6a9e1-c301-4acf-bd85-6611426f243b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:27.099040439 +0000 UTC m=+3.102712057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs") pod "network-metrics-daemon-25zcm" (UID: "25b6a9e1-c301-4acf-bd85-6611426f243b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.599081 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ec102ca-2f18-441e-bd65-8aaf7a925887-hosts-file\") pod \"node-resolver-j8fml\" (UID: \"8ec102ca-2f18-441e-bd65-8aaf7a925887\") " pod="openshift-dns/node-resolver-j8fml" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.599131 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b971b01-9e66-4de5-819e-f83aaa6995d6-konnectivity-ca\") pod \"konnectivity-agent-wn466\" (UID: \"5b971b01-9e66-4de5-819e-f83aaa6995d6\") " pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:26.599769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.599467 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-cni-binary-copy\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.601370 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.601196 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-tmp\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.601487 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.601449 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-etc-tuned\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.602692 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.602673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b971b01-9e66-4de5-819e-f83aaa6995d6-agent-certs\") pod \"konnectivity-agent-wn466\" (UID: \"5b971b01-9e66-4de5-819e-f83aaa6995d6\") " pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:26.603461 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:26.603441 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 07:02:26.603594 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:26.603467 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 07:02:26.603594 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:26.603481 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r7bq for pod openshift-network-diagnostics/network-check-target-6qdt7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:26.603594 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:26.603546 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq podName:bef75bae-f333-40b5-ac37-d89c07c499c0 nodeName:}" failed. No retries permitted until 2026-07-09 07:02:27.103529007 +0000 UTC m=+3.107200631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6r7bq" (UniqueName: "kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq") pod "network-check-target-6qdt7" (UID: "bef75bae-f333-40b5-ac37-d89c07c499c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:26.607125 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.607104 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkpwp\" (UniqueName: \"kubernetes.io/projected/25b6a9e1-c301-4acf-bd85-6611426f243b-kube-api-access-bkpwp\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:26.607125 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.607115 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-768mg\" (UniqueName: \"kubernetes.io/projected/8ec102ca-2f18-441e-bd65-8aaf7a925887-kube-api-access-768mg\") pod \"node-resolver-j8fml\" (UID: \"8ec102ca-2f18-441e-bd65-8aaf7a925887\") " pod="openshift-dns/node-resolver-j8fml" Jul 09 07:02:26.607267 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.607116 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g947\" (UniqueName: \"kubernetes.io/projected/2ceb9315-2c56-45e5-9f06-4a6cbccfffe1-kube-api-access-6g947\") pod \"tuned-r8mss\" (UID: \"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.607267 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.607119 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95bzr\" (UniqueName: \"kubernetes.io/projected/c0dccbe6-80ed-434a-966c-4cc88bcc77ec-kube-api-access-95bzr\") pod \"multus-dj2jf\" (UID: \"c0dccbe6-80ed-434a-966c-4cc88bcc77ec\") " pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.671456 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.671359 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-phqvs" Jul 09 07:02:26.681673 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.681642 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:26.683044 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:26.683007 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67470ece_214e_48ca_ac30_6de722911a50.slice/crio-a2f792c5bd3c0c97aea081f4c1fd78d185cbc867be5e77d2ca8c47ee3ad07b22 WatchSource:0}: Error finding container a2f792c5bd3c0c97aea081f4c1fd78d185cbc867be5e77d2ca8c47ee3ad07b22: Status 404 returned error can't find the container with id a2f792c5bd3c0c97aea081f4c1fd78d185cbc867be5e77d2ca8c47ee3ad07b22 Jul 09 07:02:26.690702 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:26.690676 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9343c58f_279a_480c_9946_ba85f0eef08b.slice/crio-c58d3dbe28ff35386daf69b8156cb3259cd31918c64ddd4a36e47d819f8b66db WatchSource:0}: Error finding container c58d3dbe28ff35386daf69b8156cb3259cd31918c64ddd4a36e47d819f8b66db: Status 404 returned error can't find the container with id c58d3dbe28ff35386daf69b8156cb3259cd31918c64ddd4a36e47d819f8b66db Jul 09 07:02:26.699459 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.699365 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rjps9" Jul 09 07:02:26.706152 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.706129 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" Jul 09 07:02:26.708439 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:26.708411 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60fb5c1d_e3d7_4d4c_b356_58ff313ae286.slice/crio-5415c3741f95c5f25d8c0959844c3ac72e972d9520043e9d8c432750a8926717 WatchSource:0}: Error finding container 5415c3741f95c5f25d8c0959844c3ac72e972d9520043e9d8c432750a8926717: Status 404 returned error can't find the container with id 5415c3741f95c5f25d8c0959844c3ac72e972d9520043e9d8c432750a8926717 Jul 09 07:02:26.713964 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.713939 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8lc7j" Jul 09 07:02:26.715287 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:26.715257 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ae4545_08fe_4c72_9a2e_c59380e1d96e.slice/crio-a5332387dcd8a7e93b2d47d051b3d4aca18cfcae7621ebb83923c14b923af970 WatchSource:0}: Error finding container a5332387dcd8a7e93b2d47d051b3d4aca18cfcae7621ebb83923c14b923af970: Status 404 returned error can't find the container with id a5332387dcd8a7e93b2d47d051b3d4aca18cfcae7621ebb83923c14b923af970 Jul 09 07:02:26.721887 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.721866 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j8fml" Jul 09 07:02:26.722756 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:26.722712 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42f0c2b_8932_4145_afb2_385537ef8b4c.slice/crio-a459ba9544897520185e60577a80d953d500bc6a9a5da652e282deca57751b83 WatchSource:0}: Error finding container a459ba9544897520185e60577a80d953d500bc6a9a5da652e282deca57751b83: Status 404 returned error can't find the container with id a459ba9544897520185e60577a80d953d500bc6a9a5da652e282deca57751b83 Jul 09 07:02:26.729797 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:26.729771 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec102ca_2f18_441e_bd65_8aaf7a925887.slice/crio-b90da682781c90d0634abfaca9add3e87f3ec91d147f24d248b9513506322591 WatchSource:0}: Error finding container b90da682781c90d0634abfaca9add3e87f3ec91d147f24d248b9513506322591: Status 404 returned error can't find the container with id b90da682781c90d0634abfaca9add3e87f3ec91d147f24d248b9513506322591 Jul 09 07:02:26.731461 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.731425 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8mss" Jul 09 07:02:26.739091 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.739068 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dj2jf" Jul 09 07:02:26.739342 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:26.739317 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ceb9315_2c56_45e5_9f06_4a6cbccfffe1.slice/crio-c9b0e87b867852828738e0d2a2309312aacd869b06b7ca849380e75901a91344 WatchSource:0}: Error finding container c9b0e87b867852828738e0d2a2309312aacd869b06b7ca849380e75901a91344: Status 404 returned error can't find the container with id c9b0e87b867852828738e0d2a2309312aacd869b06b7ca849380e75901a91344 Jul 09 07:02:26.744561 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:26.744540 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:26.748555 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:26.748527 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0dccbe6_80ed_434a_966c_4cc88bcc77ec.slice/crio-6dfa5c3612a717bdd4707cb050fc9b10a320cec1b3c4955b2923b95d027f8f06 WatchSource:0}: Error finding container 6dfa5c3612a717bdd4707cb050fc9b10a320cec1b3c4955b2923b95d027f8f06: Status 404 returned error can't find the container with id 6dfa5c3612a717bdd4707cb050fc9b10a320cec1b3c4955b2923b95d027f8f06 Jul 09 07:02:26.754520 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:02:26.754492 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b971b01_9e66_4de5_819e_f83aaa6995d6.slice/crio-ca1405cba7a81250df717fcdadaaf52ff2ac637978a95e948e76c19bbbc37a3c WatchSource:0}: Error finding container ca1405cba7a81250df717fcdadaaf52ff2ac637978a95e948e76c19bbbc37a3c: Status 404 returned error can't find the container with id ca1405cba7a81250df717fcdadaaf52ff2ac637978a95e948e76c19bbbc37a3c Jul 09 07:02:27.001579 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.001475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:27.001741 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:27.001678 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:27.001828 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:27.001772 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret podName:31b9f6a6-e642-410d-8e01-975cace6de3b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:28.001739305 +0000 UTC m=+4.005410942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret") pod "global-pull-secret-syncer-xbl78" (UID: "31b9f6a6-e642-410d-8e01-975cace6de3b") : object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:27.102871 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.102837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:27.103036 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:27.103001 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:27.103144 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:27.103070 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs podName:25b6a9e1-c301-4acf-bd85-6611426f243b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:28.103054506 +0000 UTC m=+4.106726121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs") pod "network-metrics-daemon-25zcm" (UID: "25b6a9e1-c301-4acf-bd85-6611426f243b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:27.204039 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.204000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7bq\" (UniqueName: \"kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq\") pod \"network-check-target-6qdt7\" (UID: \"bef75bae-f333-40b5-ac37-d89c07c499c0\") " pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:27.204229 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:27.204167 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 07:02:27.204229 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:27.204193 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 07:02:27.204229 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:27.204204 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r7bq for pod openshift-network-diagnostics/network-check-target-6qdt7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:27.204344 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:27.204263 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq podName:bef75bae-f333-40b5-ac37-d89c07c499c0 nodeName:}" failed. No retries permitted until 2026-07-09 07:02:28.204248347 +0000 UTC m=+4.207919972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r7bq" (UniqueName: "kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq") pod "network-check-target-6qdt7" (UID: "bef75bae-f333-40b5-ac37-d89c07c499c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:27.410717 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.410614 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 06:57:27 +0000 UTC" deadline="2028-02-22 06:51:19.69782343 +0000 UTC" Jul 09 07:02:27.410717 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.410661 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14231h48m52.287167785s" Jul 09 07:02:27.520875 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.520854 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:27.521340 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.520855 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:27.521340 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:27.520967 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:27.521340 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:27.521080 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:27.521340 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.520854 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:27.521340 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:27.521243 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:27.530616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.530587 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wn466" event={"ID":"5b971b01-9e66-4de5-819e-f83aaa6995d6","Type":"ContainerStarted","Data":"ca1405cba7a81250df717fcdadaaf52ff2ac637978a95e948e76c19bbbc37a3c"} Jul 09 07:02:27.531751 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.531718 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dj2jf" event={"ID":"c0dccbe6-80ed-434a-966c-4cc88bcc77ec","Type":"ContainerStarted","Data":"6dfa5c3612a717bdd4707cb050fc9b10a320cec1b3c4955b2923b95d027f8f06"} Jul 09 07:02:27.533181 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.533157 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rjps9" event={"ID":"60fb5c1d-e3d7-4d4c-b356-58ff313ae286","Type":"ContainerStarted","Data":"5415c3741f95c5f25d8c0959844c3ac72e972d9520043e9d8c432750a8926717"} Jul 09 07:02:27.534927 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.534885 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" event={"ID":"9343c58f-279a-480c-9946-ba85f0eef08b","Type":"ContainerStarted","Data":"c58d3dbe28ff35386daf69b8156cb3259cd31918c64ddd4a36e47d819f8b66db"} Jul 09 07:02:27.539730 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.539703 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8mss" event={"ID":"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1","Type":"ContainerStarted","Data":"c9b0e87b867852828738e0d2a2309312aacd869b06b7ca849380e75901a91344"} Jul 09 07:02:27.541526 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.541501 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j8fml" event={"ID":"8ec102ca-2f18-441e-bd65-8aaf7a925887","Type":"ContainerStarted","Data":"b90da682781c90d0634abfaca9add3e87f3ec91d147f24d248b9513506322591"} Jul 09 07:02:27.542850 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.542824 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lc7j" event={"ID":"c42f0c2b-8932-4145-afb2-385537ef8b4c","Type":"ContainerStarted","Data":"a459ba9544897520185e60577a80d953d500bc6a9a5da652e282deca57751b83"} Jul 09 07:02:27.544201 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.544163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" event={"ID":"75ae4545-08fe-4c72-9a2e-c59380e1d96e","Type":"ContainerStarted","Data":"a5332387dcd8a7e93b2d47d051b3d4aca18cfcae7621ebb83923c14b923af970"} Jul 09 07:02:27.545431 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.545401 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-phqvs" event={"ID":"67470ece-214e-48ca-ac30-6de722911a50","Type":"ContainerStarted","Data":"a2f792c5bd3c0c97aea081f4c1fd78d185cbc867be5e77d2ca8c47ee3ad07b22"} Jul 09 07:02:27.547432 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:27.547407 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" event={"ID":"cc853c8f2f1ea6a968532ff9703fcfa8","Type":"ContainerStarted","Data":"efcc48719474451b535cfdddb11bcf4c650259217e723cffaac96370e734ea92"} Jul 09 07:02:28.011378 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:28.011094 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:28.011577 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:28.011286 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:28.011577 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:28.011535 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret podName:31b9f6a6-e642-410d-8e01-975cace6de3b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:30.011513234 +0000 UTC m=+6.015184876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret") pod "global-pull-secret-syncer-xbl78" (UID: "31b9f6a6-e642-410d-8e01-975cace6de3b") : object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:28.112238 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:28.112196 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:28.112438 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:28.112374 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:28.112517 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:28.112450 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs podName:25b6a9e1-c301-4acf-bd85-6611426f243b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:30.112427957 +0000 UTC m=+6.116099587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs") pod "network-metrics-daemon-25zcm" (UID: "25b6a9e1-c301-4acf-bd85-6611426f243b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:28.213478 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:28.213437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7bq\" (UniqueName: \"kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq\") pod \"network-check-target-6qdt7\" (UID: \"bef75bae-f333-40b5-ac37-d89c07c499c0\") " pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:28.213723 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:28.213681 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 07:02:28.213723 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:28.213708 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 07:02:28.213723 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:28.213721 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r7bq for pod openshift-network-diagnostics/network-check-target-6qdt7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:28.213959 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:28.213810 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq podName:bef75bae-f333-40b5-ac37-d89c07c499c0 nodeName:}" failed. No retries permitted until 2026-07-09 07:02:30.213767588 +0000 UTC m=+6.217439207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r7bq" (UniqueName: "kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq") pod "network-check-target-6qdt7" (UID: "bef75bae-f333-40b5-ac37-d89c07c499c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:28.415885 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:28.411764 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 06:57:27 +0000 UTC" deadline="2028-04-13 02:07:23.174718484 +0000 UTC" Jul 09 07:02:28.415885 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:28.411842 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15451h4m54.762880737s" Jul 09 07:02:28.574474 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:28.574435 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-118.ec2.internal" event={"ID":"e23d70a312ac711b759fd35bb366a792","Type":"ContainerStarted","Data":"2a0886ee260b288c7d1815fc60c8544e34e13def6a24967715f34b3c024aebd6"} Jul 09 07:02:28.591039 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:28.590700 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-118.ec2.internal" podStartSLOduration=2.590677773 podStartE2EDuration="2.590677773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:02:28.590237616 +0000 UTC m=+4.593909624" watchObservedRunningTime="2026-07-09 07:02:28.590677773 +0000 UTC m=+4.594349413" Jul 09 07:02:29.521015 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:29.520930 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:29.521280 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:29.521079 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:29.521548 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:29.521527 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:29.521659 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:29.521635 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:29.521738 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:29.521707 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:29.521843 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:29.521806 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:30.036035 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:30.035361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:30.036035 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:30.035566 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:30.036035 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:30.035636 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret podName:31b9f6a6-e642-410d-8e01-975cace6de3b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:34.035615013 +0000 UTC m=+10.039286629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret") pod "global-pull-secret-syncer-xbl78" (UID: "31b9f6a6-e642-410d-8e01-975cace6de3b") : object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:30.136534 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:30.135851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:30.136534 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:30.136083 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:30.136534 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:30.136155 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs podName:25b6a9e1-c301-4acf-bd85-6611426f243b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:34.136134897 +0000 UTC m=+10.139806518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs") pod "network-metrics-daemon-25zcm" (UID: "25b6a9e1-c301-4acf-bd85-6611426f243b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:30.236608 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:30.236456 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7bq\" (UniqueName: \"kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq\") pod \"network-check-target-6qdt7\" (UID: \"bef75bae-f333-40b5-ac37-d89c07c499c0\") " pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:30.236890 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:30.236680 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 07:02:30.236890 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:30.236709 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 07:02:30.236890 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:30.236723 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r7bq for pod openshift-network-diagnostics/network-check-target-6qdt7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:30.236890 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:30.236807 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq podName:bef75bae-f333-40b5-ac37-d89c07c499c0 nodeName:}" failed. No retries permitted until 2026-07-09 07:02:34.2367834 +0000 UTC m=+10.240455022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r7bq" (UniqueName: "kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq") pod "network-check-target-6qdt7" (UID: "bef75bae-f333-40b5-ac37-d89c07c499c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:31.521973 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:31.521505 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:31.521973 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:31.521540 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:31.521973 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:31.521709 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:31.521973 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:31.521775 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:31.521973 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:31.521842 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:31.521973 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:31.521917 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:33.521850 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:33.521196 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:33.521850 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:33.521213 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:33.521850 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:33.521363 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:33.521850 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:33.521423 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:33.521850 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:33.521213 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:33.521850 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:33.521495 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:34.075440 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:34.075394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:34.075646 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:34.075571 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:34.075646 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:34.075644 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret podName:31b9f6a6-e642-410d-8e01-975cace6de3b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:42.075621961 +0000 UTC m=+18.079293589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret") pod "global-pull-secret-syncer-xbl78" (UID: "31b9f6a6-e642-410d-8e01-975cace6de3b") : object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:34.176122 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:34.176076 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:34.176341 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:34.176286 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:34.176412 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:34.176353 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs podName:25b6a9e1-c301-4acf-bd85-6611426f243b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:42.176332082 +0000 UTC m=+18.180003716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs") pod "network-metrics-daemon-25zcm" (UID: "25b6a9e1-c301-4acf-bd85-6611426f243b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:34.276776 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:34.276729 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7bq\" (UniqueName: \"kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq\") pod \"network-check-target-6qdt7\" (UID: \"bef75bae-f333-40b5-ac37-d89c07c499c0\") " pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:34.276980 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:34.276927 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 07:02:34.276980 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:34.276955 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 07:02:34.276980 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:34.276969 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r7bq for pod openshift-network-diagnostics/network-check-target-6qdt7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:34.277159 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:34.277038 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq podName:bef75bae-f333-40b5-ac37-d89c07c499c0 nodeName:}" failed. No retries permitted until 2026-07-09 07:02:42.277017312 +0000 UTC m=+18.280688932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r7bq" (UniqueName: "kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq") pod "network-check-target-6qdt7" (UID: "bef75bae-f333-40b5-ac37-d89c07c499c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:35.520942 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:35.520729 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:35.520942 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:35.520791 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:35.520942 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:35.520791 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:35.520942 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:35.520904 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:35.521590 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:35.520988 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:35.521590 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:35.521081 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:37.521291 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:37.521254 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:37.521291 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:37.521283 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:37.521875 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:37.521450 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:37.521875 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:37.521509 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:37.521875 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:37.521585 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:37.521875 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:37.521656 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:39.520651 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:39.520616 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:39.521123 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:39.520674 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:39.521123 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:39.520626 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:39.521123 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:39.520764 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:39.521123 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:39.520897 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:39.521123 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:39.520976 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:41.521336 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:41.521296 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:41.521864 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:41.521296 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:41.521864 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:41.521434 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:41.521864 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:41.521296 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:41.521864 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:41.521496 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:41.521864 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:41.521578 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:42.136093 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:42.136055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:42.136303 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:42.136222 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:42.136303 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:42.136299 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret podName:31b9f6a6-e642-410d-8e01-975cace6de3b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:58.136278969 +0000 UTC m=+34.139950590 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret") pod "global-pull-secret-syncer-xbl78" (UID: "31b9f6a6-e642-410d-8e01-975cace6de3b") : object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:42.236925 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:42.236885 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:42.237122 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:42.237047 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:42.237187 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:42.237136 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs podName:25b6a9e1-c301-4acf-bd85-6611426f243b nodeName:}" failed. No retries permitted until 2026-07-09 07:02:58.237111658 +0000 UTC m=+34.240783286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs") pod "network-metrics-daemon-25zcm" (UID: "25b6a9e1-c301-4acf-bd85-6611426f243b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:42.337601 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:42.337563 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7bq\" (UniqueName: \"kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq\") pod \"network-check-target-6qdt7\" (UID: \"bef75bae-f333-40b5-ac37-d89c07c499c0\") " pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:42.337806 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:42.337757 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 07:02:42.337806 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:42.337780 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 07:02:42.337806 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:42.337792 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r7bq for pod openshift-network-diagnostics/network-check-target-6qdt7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:42.337952 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:42.337856 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq podName:bef75bae-f333-40b5-ac37-d89c07c499c0 nodeName:}" failed. No retries permitted until 2026-07-09 07:02:58.337838678 +0000 UTC m=+34.341510295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r7bq" (UniqueName: "kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq") pod "network-check-target-6qdt7" (UID: "bef75bae-f333-40b5-ac37-d89c07c499c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:43.521013 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:43.520981 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:43.521448 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:43.521022 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:43.521448 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:43.520981 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:43.521448 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:43.521183 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:43.521448 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:43.521244 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:43.521448 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:43.521297 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:45.521228 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:45.521193 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:45.521721 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:45.521207 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:45.521721 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:45.521328 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:45.521721 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:45.521321 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:45.521721 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:45.521425 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:45.521721 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:45.521489 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:47.520911 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.520726 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:47.521432 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.520788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:47.521432 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:47.521002 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:47.521432 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.520788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:47.521432 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:47.521062 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:47.521432 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:47.521150 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:47.625137 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.625039 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dj2jf" event={"ID":"c0dccbe6-80ed-434a-966c-4cc88bcc77ec","Type":"ContainerStarted","Data":"e2ef123a176b7e1e46f40931db73c937a8b3fc9b53c135adde6d6475db80ba32"} Jul 09 07:02:47.628561 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.628523 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" event={"ID":"9343c58f-279a-480c-9946-ba85f0eef08b","Type":"ContainerStarted","Data":"372e179e02aea194d306ee5026c1965015ff801f9bbd772f311f7acffe1973c9"} Jul 09 07:02:47.628702 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.628598 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" event={"ID":"9343c58f-279a-480c-9946-ba85f0eef08b","Type":"ContainerStarted","Data":"876bb23c5ba69e2003742eb94a3e22ba05947243b74c119bb35ac0922d3d3462"} Jul 09 07:02:47.628702 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.628644 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" event={"ID":"9343c58f-279a-480c-9946-ba85f0eef08b","Type":"ContainerStarted","Data":"c9f8931136c3093a049f4880ec2c6056a512e3357a9c0183f991d388b5be3a76"} Jul 09 07:02:47.628702 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.628688 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" event={"ID":"9343c58f-279a-480c-9946-ba85f0eef08b","Type":"ContainerStarted","Data":"8a977b790a7bdc51f515a770b1b8504b939db853d2a1b39429ced9e5acf342be"} Jul 09 07:02:47.628883 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.628747 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" event={"ID":"9343c58f-279a-480c-9946-ba85f0eef08b","Type":"ContainerStarted","Data":"08915a820d4a80bfe7ad0f3d3fd6f0199c802a0544d9fa3b4d52f41b271cc6a5"} Jul 09 07:02:47.628883 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.628798 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" event={"ID":"9343c58f-279a-480c-9946-ba85f0eef08b","Type":"ContainerStarted","Data":"000e124ba063451d4ebdd0364448a03a42d16835393f55c36ff1a637173bf0b7"} Jul 09 07:02:47.630269 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.630241 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8mss" event={"ID":"2ceb9315-2c56-45e5-9f06-4a6cbccfffe1","Type":"ContainerStarted","Data":"0c3a3066b7bd8b37734522b621213efea01d0b7fbef342fd76d631a6940d8d1c"} Jul 09 07:02:47.641171 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.641131 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dj2jf" podStartSLOduration=2.5232547 podStartE2EDuration="22.641120007s" totalImagesPullingTime="20.117865307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:02:47.640875749 +0000 UTC m=+23.644547384" watchObservedRunningTime="2026-07-09 07:02:47.641120007 +0000 UTC m=+23.644791643" Jul 09 07:02:47.656457 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:47.656422 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r8mss" podStartSLOduration=2.5850316319999997 podStartE2EDuration="22.656411566s" totalImagesPullingTime="20.071379934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:02:47.654975918 +0000 UTC m=+23.658647553" watchObservedRunningTime="2026-07-09 07:02:47.656411566 +0000 UTC m=+23.660083200" Jul 09 07:02:48.633948 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.633657 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-phqvs" event={"ID":"67470ece-214e-48ca-ac30-6de722911a50","Type":"ContainerStarted","Data":"671da9d643ce21fed4290fce585e41e1572a447322e2b06224de00ea6986cea6"} Jul 09 07:02:48.635236 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.635212 2565 generic.go:356] "Generic (PLEG): container finished" podID="cc853c8f2f1ea6a968532ff9703fcfa8" containerID="35145a26f3fe37c842221b5d30ce37b5f71a630946a6244a0a77a4f7869b53a9" exitCode=0 Jul 09 07:02:48.635350 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.635280 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" event={"ID":"cc853c8f2f1ea6a968532ff9703fcfa8","Type":"ContainerDied","Data":"35145a26f3fe37c842221b5d30ce37b5f71a630946a6244a0a77a4f7869b53a9"} Jul 09 07:02:48.636743 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.636717 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wn466" event={"ID":"5b971b01-9e66-4de5-819e-f83aaa6995d6","Type":"ContainerStarted","Data":"74b9eba45c5ed39e92b314956bcf6f1bb3fda1d5e56d4141c4caaae3ce9a4507"} Jul 09 07:02:48.638189 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.638164 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rjps9" event={"ID":"60fb5c1d-e3d7-4d4c-b356-58ff313ae286","Type":"ContainerStarted","Data":"6b96cb14420ff6b766c383bce8d3d5dcad302b6d7c34b39767ac29d14182e36f"} Jul 09 07:02:48.639519 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.639500 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j8fml" event={"ID":"8ec102ca-2f18-441e-bd65-8aaf7a925887","Type":"ContainerStarted","Data":"290d2ce1a5c9d3a40e3a9adffeae561811712aac567aeeaaba13d7147db53c1c"} Jul 09 07:02:48.641041 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.641022 2565 generic.go:356] "Generic (PLEG): container finished" podID="c42f0c2b-8932-4145-afb2-385537ef8b4c" containerID="611ac17d98b0db5e60cb87f78ae670f7826a8b478e323f40be93f8f3c581617a" exitCode=0 Jul 09 07:02:48.641121 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.641085 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lc7j" event={"ID":"c42f0c2b-8932-4145-afb2-385537ef8b4c","Type":"ContainerDied","Data":"611ac17d98b0db5e60cb87f78ae670f7826a8b478e323f40be93f8f3c581617a"} Jul 09 07:02:48.642481 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.642460 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" event={"ID":"75ae4545-08fe-4c72-9a2e-c59380e1d96e","Type":"ContainerStarted","Data":"aa69927b8547ec457165bde9f7994ee1ae5ae1245b7463f5a1bee13be9883495"} Jul 09 07:02:48.647541 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.647505 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-phqvs" podStartSLOduration=3.521179499 podStartE2EDuration="23.647494047s" totalImagesPullingTime="20.126314548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:02:48.647269208 +0000 UTC m=+24.650940844" watchObservedRunningTime="2026-07-09 07:02:48.647494047 +0000 UTC m=+24.651165730" Jul 09 07:02:48.681229 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.681181 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j8fml" podStartSLOduration=3.599491719 podStartE2EDuration="23.681165719s" totalImagesPullingTime="20.081674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:02:48.661077929 +0000 UTC m=+24.664749563" watchObservedRunningTime="2026-07-09 07:02:48.681165719 +0000 UTC m=+24.684837370" Jul 09 07:02:48.693904 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.693860 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wn466" podStartSLOduration=3.659311345 podStartE2EDuration="23.693842708s" totalImagesPullingTime="20.034531363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:02:48.693366387 +0000 UTC m=+24.697038024" watchObservedRunningTime="2026-07-09 07:02:48.693842708 +0000 UTC m=+24.697514345" Jul 09 07:02:48.719105 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:48.719066 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rjps9" podStartSLOduration=7.762922092 podStartE2EDuration="23.719052535s" totalImagesPullingTime="15.956130443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:02:48.718899506 +0000 UTC m=+24.722571142" watchObservedRunningTime="2026-07-09 07:02:48.719052535 +0000 UTC m=+24.722724169" Jul 09 07:02:49.521070 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:49.520995 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:49.521360 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:49.521168 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:49.521360 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:49.521184 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:49.521360 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:49.521253 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:49.521360 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:49.521299 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:49.521575 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:49.521368 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:49.646848 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:49.646803 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" event={"ID":"cc853c8f2f1ea6a968532ff9703fcfa8","Type":"ContainerStarted","Data":"ba0f4354344e24d254c505c2937561717e3a16262e2e4632a68e314296731e67"} Jul 09 07:02:49.664052 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:49.663997 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-118.ec2.internal" podStartSLOduration=23.663977777 podStartE2EDuration="23.663977777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:02:49.663551926 +0000 UTC m=+25.667223561" watchObservedRunningTime="2026-07-09 07:02:49.663977777 +0000 UTC m=+25.667649412" Jul 09 07:02:50.365033 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:50.365007 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 07:02:50.455025 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:50.454912 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T07:02:50.365029125Z","UUID":"9c125087-c49e-4546-9c77-8d52b61a0a42","Handler":null,"Name":"","Endpoint":""} Jul 09 07:02:50.456604 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:50.456566 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 07:02:50.456770 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:50.456612 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 07:02:50.651661 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:50.651581 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" event={"ID":"75ae4545-08fe-4c72-9a2e-c59380e1d96e","Type":"ContainerStarted","Data":"17ff615172f7c33b84f4025b3d8cd04008d4a333645e9c197786360320cccbf0"} Jul 09 07:02:50.655524 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:50.655486 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" event={"ID":"9343c58f-279a-480c-9946-ba85f0eef08b","Type":"ContainerStarted","Data":"f0df9c7dc49a3659f09d21599d407aeeb554b682d0376d430525d18a12279397"} Jul 09 07:02:51.520893 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:51.520866 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:51.521054 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:51.520968 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:51.521054 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:51.520977 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:51.521054 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:51.520994 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:51.521156 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:51.521061 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:51.521156 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:51.521113 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:52.429449 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:52.429231 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:52.429977 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:52.429956 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:52.663021 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:52.662926 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" event={"ID":"75ae4545-08fe-4c72-9a2e-c59380e1d96e","Type":"ContainerStarted","Data":"1b24f9895f1ff3c980de1f4138d0f8b5c75a5b45c7e652b9707f50a05406cd53"} Jul 09 07:02:52.663360 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:52.663340 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:52.663866 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:52.663837 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wn466" Jul 09 07:02:52.679175 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:52.679111 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgng" podStartSLOduration=3.9029058819999998 podStartE2EDuration="27.679097314s" totalImagesPullingTime="23.776191432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:02:52.678690769 +0000 UTC m=+28.682362452" watchObservedRunningTime="2026-07-09 07:02:52.679097314 +0000 UTC m=+28.682768949" Jul 09 07:02:53.521275 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:53.521191 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:53.521275 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:53.521220 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:53.522211 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:53.521285 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:53.522211 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:53.521308 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:53.522211 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:53.521358 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:53.522211 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:53.521427 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:53.668843 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:53.668763 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" event={"ID":"9343c58f-279a-480c-9946-ba85f0eef08b","Type":"ContainerStarted","Data":"2998b587fe726243205e9ca2f03e3b75d19b91b96d65a29ac3aa471eb854815e"} Jul 09 07:02:53.696130 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:53.696073 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" podStartSLOduration=8.514430147 podStartE2EDuration="28.696057964s" totalImagesPullingTime="20.181627817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:02:53.695006464 +0000 UTC m=+29.698678099" watchObservedRunningTime="2026-07-09 07:02:53.696057964 +0000 UTC m=+29.699729598" Jul 09 07:02:54.675349 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:54.675106 2565 generic.go:356] "Generic (PLEG): container finished" podID="c42f0c2b-8932-4145-afb2-385537ef8b4c" containerID="a6a673bf0aaf2d08f38db29cf641d5b71d65a2435e739ef35d3703448a9a2e32" exitCode=0 Jul 09 07:02:54.676083 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:54.675223 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lc7j" event={"ID":"c42f0c2b-8932-4145-afb2-385537ef8b4c","Type":"ContainerDied","Data":"a6a673bf0aaf2d08f38db29cf641d5b71d65a2435e739ef35d3703448a9a2e32"} Jul 09 07:02:54.676648 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:54.676095 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:54.676648 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:54.676162 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:54.676648 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:54.676212 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:54.697172 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:54.697140 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:54.697361 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:54.697340 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:02:55.461142 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:55.461106 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xbl78"] Jul 09 07:02:55.461337 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:55.461282 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:55.461429 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:55.461405 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:55.463820 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:55.463793 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6qdt7"] Jul 09 07:02:55.463970 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:55.463906 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:55.464031 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:55.463992 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:55.464418 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:55.464397 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-25zcm"] Jul 09 07:02:55.464535 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:55.464516 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:55.464654 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:55.464610 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:56.682069 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:56.682015 2565 generic.go:356] "Generic (PLEG): container finished" podID="c42f0c2b-8932-4145-afb2-385537ef8b4c" containerID="8e6d19948b4e3419f38e7af9fbea98aeb3371299d2a3010a5472af845b62ecbe" exitCode=0 Jul 09 07:02:56.682417 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:56.682094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lc7j" event={"ID":"c42f0c2b-8932-4145-afb2-385537ef8b4c","Type":"ContainerDied","Data":"8e6d19948b4e3419f38e7af9fbea98aeb3371299d2a3010a5472af845b62ecbe"} Jul 09 07:02:57.521103 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:57.520892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:57.521272 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:57.520930 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:57.521272 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:57.521185 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:57.521272 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:57.520937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:57.521394 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:57.521245 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:57.521394 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:57.521346 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:58.160988 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:58.160902 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:58.161345 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:58.161025 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:58.161345 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:58.161079 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret podName:31b9f6a6-e642-410d-8e01-975cace6de3b nodeName:}" failed. No retries permitted until 2026-07-09 07:03:30.161067284 +0000 UTC m=+66.164738897 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret") pod "global-pull-secret-syncer-xbl78" (UID: "31b9f6a6-e642-410d-8e01-975cace6de3b") : object "kube-system"/"original-pull-secret" not registered Jul 09 07:02:58.261465 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:58.261417 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:58.261634 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:58.261571 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:58.261673 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:58.261636 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs podName:25b6a9e1-c301-4acf-bd85-6611426f243b nodeName:}" failed. No retries permitted until 2026-07-09 07:03:30.261621585 +0000 UTC m=+66.265293200 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs") pod "network-metrics-daemon-25zcm" (UID: "25b6a9e1-c301-4acf-bd85-6611426f243b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 07:02:58.362434 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:58.362390 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7bq\" (UniqueName: \"kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq\") pod \"network-check-target-6qdt7\" (UID: \"bef75bae-f333-40b5-ac37-d89c07c499c0\") " pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:58.362594 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:58.362556 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 07:02:58.362594 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:58.362576 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 07:02:58.362594 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:58.362585 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r7bq for pod openshift-network-diagnostics/network-check-target-6qdt7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:58.362694 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:58.362636 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq podName:bef75bae-f333-40b5-ac37-d89c07c499c0 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:30.362622163 +0000 UTC m=+66.366293776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r7bq" (UniqueName: "kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq") pod "network-check-target-6qdt7" (UID: "bef75bae-f333-40b5-ac37-d89c07c499c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 07:02:59.520808 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.520776 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:02:59.521172 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.520776 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:02:59.521172 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:59.520884 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qdt7" podUID="bef75bae-f333-40b5-ac37-d89c07c499c0" Jul 09 07:02:59.521172 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.520776 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:02:59.521172 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:59.520960 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbl78" podUID="31b9f6a6-e642-410d-8e01-975cace6de3b" Jul 09 07:02:59.521172 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:02:59.521044 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zcm" podUID="25b6a9e1-c301-4acf-bd85-6611426f243b" Jul 09 07:02:59.691724 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.691635 2565 generic.go:356] "Generic (PLEG): container finished" podID="c42f0c2b-8932-4145-afb2-385537ef8b4c" containerID="f55fe9868ff4dc62a4219af903ad10441746dd161f87b8786687dfbbe89b6658" exitCode=0 Jul 09 07:02:59.691724 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.691696 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lc7j" event={"ID":"c42f0c2b-8932-4145-afb2-385537ef8b4c","Type":"ContainerDied","Data":"f55fe9868ff4dc62a4219af903ad10441746dd161f87b8786687dfbbe89b6658"} Jul 09 07:02:59.747208 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.747183 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-118.ec2.internal" event="NodeReady" Jul 09 07:02:59.747352 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.747315 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 07:02:59.778663 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.778630 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxmdp"] Jul 09 07:02:59.782520 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.782492 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxmdp" Jul 09 07:02:59.784782 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.784758 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7"] Jul 09 07:02:59.787710 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.787689 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 07:02:59.787833 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.787723 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 07:02:59.787833 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.787724 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9rrxj\"" Jul 09 07:02:59.787833 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.787808 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f48c84f45-4pdpl"] Jul 09 07:02:59.788001 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.787973 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:02:59.789578 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.789558 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw"] Jul 09 07:02:59.789676 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.789666 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:02:59.790205 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.790185 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 07:02:59.790443 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.790428 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5gtzk\"" Jul 09 07:02:59.790726 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.790494 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 07:02:59.790726 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.790546 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 07:02:59.791237 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.791220 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-m5h6q"] Jul 09 07:02:59.791363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.791332 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:02:59.792614 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.792596 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 07:02:59.792792 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.792775 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 07:02:59.792972 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.792955 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw"] Jul 09 07:02:59.792972 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.792965 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lg8gc\"" Jul 09 07:02:59.793126 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.792977 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 07:02:59.793126 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.793105 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:02:59.794035 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.794004 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 07:02:59.794141 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.794126 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 07:02:59.794209 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.794145 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 07:02:59.794263 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.794249 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 07:02:59.794362 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.794343 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 07:02:59.794412 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.794402 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 07:02:59.794547 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.794508 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 07:02:59.794640 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.794604 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9rb85\"" Jul 09 07:02:59.796247 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.795075 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7446669d59-54vd2"] Jul 09 07:02:59.796247 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.795391 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" Jul 09 07:02:59.797211 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.796379 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 07:02:59.797211 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.796712 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 07:02:59.797211 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.797006 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 07:02:59.797211 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.797212 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 07:02:59.797498 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.797240 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4spmv\"" Jul 09 07:02:59.797554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.797509 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 07:02:59.797813 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.797797 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 07:02:59.797915 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.797797 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 07:02:59.798192 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.798176 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 07:02:59.798637 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.798617 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxmdp"] Jul 09 07:02:59.798769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.798652 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7"] Jul 09 07:02:59.798769 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.798767 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:02:59.800860 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.799844 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kqghp\"" Jul 09 07:02:59.805774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.801938 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj"] Jul 09 07:02:59.805774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.802053 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 07:02:59.805774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.802465 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 07:02:59.805774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.802764 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 07:02:59.805774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.805059 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw"] Jul 09 07:02:59.805774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.805089 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl"] Jul 09 07:02:59.805774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.805134 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z7kjk\"" Jul 09 07:02:59.806859 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.806842 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:02:59.809218 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.807868 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6xwd9"] Jul 09 07:02:59.809218 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.808179 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" Jul 09 07:02:59.809218 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.808589 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 07:02:59.814648 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.814624 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 07:02:59.814797 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.814658 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 07:02:59.814867 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.814800 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 07:02:59.814923 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.814802 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 07:02:59.814975 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.814961 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 07:02:59.816142 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.815776 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-84kgt\"" Jul 09 07:02:59.816142 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.815987 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 07:02:59.816142 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.816140 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 07:02:59.816334 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.816187 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vnj9j"] Jul 09 07:02:59.816489 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.816361 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w89gz\"" Jul 09 07:02:59.816715 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.816698 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6xwd9" Jul 09 07:02:59.818065 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.818038 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw"] Jul 09 07:02:59.818158 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.818077 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f48c84f45-4pdpl"] Jul 09 07:02:59.818158 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.818120 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:02:59.818264 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.818165 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-m5h6q"] Jul 09 07:02:59.819068 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.819051 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6nhkn\"" Jul 09 07:02:59.819190 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.819057 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 07:02:59.819514 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.819499 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 07:02:59.820866 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.820846 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj"] Jul 09 07:02:59.821486 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.821466 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 07:02:59.821598 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.821565 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 07:02:59.821797 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.821780 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 07:02:59.821921 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.821840 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6xwd9"] Jul 09 07:02:59.822007 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.821926 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rvcrt\"" Jul 09 07:02:59.823102 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.822339 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h82ff"] Jul 09 07:02:59.823333 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.823316 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 07:02:59.826910 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.826892 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n4z2f"] Jul 09 07:02:59.827102 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.826979 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h82ff" Jul 09 07:02:59.829027 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.829009 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl"] Jul 09 07:02:59.829205 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.829043 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vnj9j"] Jul 09 07:02:59.829205 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.829062 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7446669d59-54vd2"] Jul 09 07:02:59.829432 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.829388 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 07:02:59.829432 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.829401 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 07:02:59.829432 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.829422 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4z2f" Jul 09 07:02:59.829633 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.829615 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kvbwn\"" Jul 09 07:02:59.829685 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.829641 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 07:02:59.829788 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.829772 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 07:02:59.831583 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.831561 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k8zmf\"" Jul 09 07:02:59.831583 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.831564 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 07:02:59.833040 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.833025 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 07:02:59.835616 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.835599 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h82ff"] Jul 09 07:02:59.840306 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.840283 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4z2f"] Jul 09 07:02:59.974481 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:02:59.974481 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-bound-sa-token\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:02:59.974481 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-stats-auth\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:02:59.974708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:02:59.974708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lpj9\" (UniqueName: \"kubernetes.io/projected/023abe38-620c-4d2e-8cf4-990b2b3bc35d-kube-api-access-7lpj9\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:02:59.974708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8dnx\" (UniqueName: \"kubernetes.io/projected/01fa2a56-c1cc-4509-b017-989d6363d2cf-kube-api-access-l8dnx\") pod \"ingress-canary-h82ff\" (UID: \"01fa2a56-c1cc-4509-b017-989d6363d2cf\") " pod="openshift-ingress-canary/ingress-canary-h82ff" Jul 09 07:02:59.974708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/023abe38-620c-4d2e-8cf4-990b2b3bc35d-config\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:02:59.974708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974627 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-tmp\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:02:59.974708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-serving-cert\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:02:59.974708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnj25\" (UniqueName: \"kubernetes.io/projected/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-kube-api-access-nnj25\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:02:59.974708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-ca-trust-extracted\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:02:59.974708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974693 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b9ql\" (UniqueName: \"kubernetes.io/projected/eb8bcf2d-5a87-42e3-a544-293f84ed1a33-kube-api-access-2b9ql\") pod \"volume-data-source-validator-5d456fdbcd-pxmdp\" (UID: \"eb8bcf2d-5a87-42e3-a544-293f84ed1a33\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxmdp" Jul 09 07:02:59.974708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974711 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e40f8186-5321-4692-8303-24eb101a2fdb-config-volume\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zl4s\" (UniqueName: \"kubernetes.io/projected/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-kube-api-access-4zl4s\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974875 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/546495c0-daf9-46dd-b67f-89e0fff7fd2d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-fwvlw\" (UID: \"546495c0-daf9-46dd-b67f-89e0fff7fd2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974905 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974956 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-default-certificate\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.974981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpmms\" (UniqueName: \"kubernetes.io/projected/e40f8186-5321-4692-8303-24eb101a2fdb-kube-api-access-mpmms\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975011 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6pfh\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-kube-api-access-l6pfh\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/023abe38-620c-4d2e-8cf4-990b2b3bc35d-serving-cert\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-trusted-ca\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975059 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd6gm\" (UniqueName: \"kubernetes.io/projected/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-kube-api-access-nd6gm\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:02:59.975118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975111 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzvh\" (UniqueName: \"kubernetes.io/projected/95c00add-a461-4777-b35b-b9055c31020f-kube-api-access-4kzvh\") pod \"network-check-source-989f8b8dc-6xwd9\" (UID: \"95c00add-a461-4777-b35b-b9055c31020f\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6xwd9" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e40f8186-5321-4692-8303-24eb101a2fdb-tmp-dir\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-certificates\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f1db7b2-77fb-4e70-93c3-01ca47c88100-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975364 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-image-registry-private-configuration\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975405 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/023abe38-620c-4d2e-8cf4-990b2b3bc35d-trusted-ca\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6966bf5f-cc1f-4c4c-8cdf-5ba57383d978-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gwkcl\" (UID: \"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-installation-pull-secrets\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975509 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b2nx\" (UniqueName: \"kubernetes.io/projected/546495c0-daf9-46dd-b67f-89e0fff7fd2d-kube-api-access-6b2nx\") pod \"kube-storage-version-migrator-operator-846bf668f7-fwvlw\" (UID: \"546495c0-daf9-46dd-b67f-89e0fff7fd2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01fa2a56-c1cc-4509-b017-989d6363d2cf-cert\") pod \"ingress-canary-h82ff\" (UID: \"01fa2a56-c1cc-4509-b017-989d6363d2cf\") " pod="openshift-ingress-canary/ingress-canary-h82ff" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975550 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgkww\" (UniqueName: \"kubernetes.io/projected/4f1db7b2-77fb-4e70-93c3-01ca47c88100-kube-api-access-kgkww\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:02:59.975588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blmz7\" (UniqueName: \"kubernetes.io/projected/6966bf5f-cc1f-4c4c-8cdf-5ba57383d978-kube-api-access-blmz7\") pod \"service-ca-operator-5d46d9ffd4-gwkcl\" (UID: \"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" Jul 09 07:02:59.976026 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/546495c0-daf9-46dd-b67f-89e0fff7fd2d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-fwvlw\" (UID: \"546495c0-daf9-46dd-b67f-89e0fff7fd2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" Jul 09 07:02:59.976026 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975633 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-snapshots\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:02:59.976026 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:02:59.975660 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6966bf5f-cc1f-4c4c-8cdf-5ba57383d978-config\") pod \"service-ca-operator-5d46d9ffd4-gwkcl\" (UID: \"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" Jul 09 07:03:00.076118 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.076290 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:03:00.076290 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/023abe38-620c-4d2e-8cf4-990b2b3bc35d-trusted-ca\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:00.076290 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6966bf5f-cc1f-4c4c-8cdf-5ba57383d978-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gwkcl\" (UID: \"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" Jul 09 07:03:00.076290 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-installation-pull-secrets\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.076290 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b2nx\" (UniqueName: \"kubernetes.io/projected/546495c0-daf9-46dd-b67f-89e0fff7fd2d-kube-api-access-6b2nx\") pod \"kube-storage-version-migrator-operator-846bf668f7-fwvlw\" (UID: \"546495c0-daf9-46dd-b67f-89e0fff7fd2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" Jul 09 07:03:00.076290 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076248 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01fa2a56-c1cc-4509-b017-989d6363d2cf-cert\") pod \"ingress-canary-h82ff\" (UID: \"01fa2a56-c1cc-4509-b017-989d6363d2cf\") " pod="openshift-ingress-canary/ingress-canary-h82ff" Jul 09 07:03:00.076290 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgkww\" (UniqueName: \"kubernetes.io/projected/4f1db7b2-77fb-4e70-93c3-01ca47c88100-kube-api-access-kgkww\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:00.076290 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blmz7\" (UniqueName: \"kubernetes.io/projected/6966bf5f-cc1f-4c4c-8cdf-5ba57383d978-kube-api-access-blmz7\") pod \"service-ca-operator-5d46d9ffd4-gwkcl\" (UID: \"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" Jul 09 07:03:00.076684 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076314 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/546495c0-daf9-46dd-b67f-89e0fff7fd2d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-fwvlw\" (UID: \"546495c0-daf9-46dd-b67f-89e0fff7fd2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" Jul 09 07:03:00.076684 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-snapshots\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.076684 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6966bf5f-cc1f-4c4c-8cdf-5ba57383d978-config\") pod \"service-ca-operator-5d46d9ffd4-gwkcl\" (UID: \"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" Jul 09 07:03:00.076684 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076390 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.076684 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076413 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-bound-sa-token\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.076684 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-stats-auth\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:00.076684 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.076684 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lpj9\" (UniqueName: \"kubernetes.io/projected/023abe38-620c-4d2e-8cf4-990b2b3bc35d-kube-api-access-7lpj9\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:00.076684 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.076511 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 07:03:00.076684 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.076592 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert podName:f62e9f63-ef1f-4906-8a5b-19047a9e69b6 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:00.576574001 +0000 UTC m=+36.580245628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7g8lj" (UID: "f62e9f63-ef1f-4906-8a5b-19047a9e69b6") : secret "networking-console-plugin-cert" not found Jul 09 07:03:00.077164 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076794 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.077164 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.076521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8dnx\" (UniqueName: \"kubernetes.io/projected/01fa2a56-c1cc-4509-b017-989d6363d2cf-kube-api-access-l8dnx\") pod \"ingress-canary-h82ff\" (UID: \"01fa2a56-c1cc-4509-b017-989d6363d2cf\") " pod="openshift-ingress-canary/ingress-canary-h82ff" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077424 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-snapshots\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/023abe38-620c-4d2e-8cf4-990b2b3bc35d-config\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077524 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-tmp\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077547 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-serving-cert\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnj25\" (UniqueName: \"kubernetes.io/projected/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-kube-api-access-nnj25\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077599 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-ca-trust-extracted\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.077629 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.077650 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7446669d59-54vd2: secret "image-registry-tls" not found Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.077715 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls podName:7c6a5609-ef3b-4d4a-8dd0-a03e03217284 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:00.577696961 +0000 UTC m=+36.581368581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls") pod "image-registry-7446669d59-54vd2" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284") : secret "image-registry-tls" not found Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077631 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b9ql\" (UniqueName: \"kubernetes.io/projected/eb8bcf2d-5a87-42e3-a544-293f84ed1a33-kube-api-access-2b9ql\") pod \"volume-data-source-validator-5d456fdbcd-pxmdp\" (UID: \"eb8bcf2d-5a87-42e3-a544-293f84ed1a33\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxmdp" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e40f8186-5321-4692-8303-24eb101a2fdb-config-volume\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077811 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077827 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/023abe38-620c-4d2e-8cf4-990b2b3bc35d-trusted-ca\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zl4s\" (UniqueName: \"kubernetes.io/projected/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-kube-api-access-4zl4s\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077862 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/546495c0-daf9-46dd-b67f-89e0fff7fd2d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-fwvlw\" (UID: \"546495c0-daf9-46dd-b67f-89e0fff7fd2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" Jul 09 07:03:00.078380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077913 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077939 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-default-certificate\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpmms\" (UniqueName: \"kubernetes.io/projected/e40f8186-5321-4692-8303-24eb101a2fdb-kube-api-access-mpmms\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.077999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6pfh\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-kube-api-access-l6pfh\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/023abe38-620c-4d2e-8cf4-990b2b3bc35d-serving-cert\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-trusted-ca\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078082 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-tmp\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd6gm\" (UniqueName: \"kubernetes.io/projected/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-kube-api-access-nd6gm\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078143 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078168 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzvh\" (UniqueName: \"kubernetes.io/projected/95c00add-a461-4777-b35b-b9055c31020f-kube-api-access-4kzvh\") pod \"network-check-source-989f8b8dc-6xwd9\" (UID: \"95c00add-a461-4777-b35b-b9055c31020f\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6xwd9" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/023abe38-620c-4d2e-8cf4-990b2b3bc35d-config\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078445 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6966bf5f-cc1f-4c4c-8cdf-5ba57383d978-config\") pod \"service-ca-operator-5d46d9ffd4-gwkcl\" (UID: \"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.078695 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078699 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e40f8186-5321-4692-8303-24eb101a2fdb-config-volume\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:00.079232 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.078779 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls podName:f1a26e1c-41a8-42a9-8b7e-e48383dec2b9 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:00.578761687 +0000 UTC m=+36.582433355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-r6qv7" (UID: "f1a26e1c-41a8-42a9-8b7e-e48383dec2b9") : secret "samples-operator-tls" not found Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e40f8186-5321-4692-8303-24eb101a2fdb-tmp-dir\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078868 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-certificates\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.078887 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:00.578868049 +0000 UTC m=+36.582539684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : configmap references non-existent config key: service-ca.crt Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078930 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f1db7b2-77fb-4e70-93c3-01ca47c88100-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.078965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-image-registry-private-configuration\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.079356 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-certificates\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.079571 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.079644 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.079684 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls podName:e40f8186-5321-4692-8303-24eb101a2fdb nodeName:}" failed. No retries permitted until 2026-07-09 07:03:00.579671039 +0000 UTC m=+36.583342685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls") pod "dns-default-n4z2f" (UID: "e40f8186-5321-4692-8303-24eb101a2fdb") : secret "dns-default-metrics-tls" not found Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.079770 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.079806 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls podName:4f1db7b2-77fb-4e70-93c3-01ca47c88100 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:00.579794804 +0000 UTC m=+36.583466417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkcw" (UID: "4f1db7b2-77fb-4e70-93c3-01ca47c88100") : secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:00.080052 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.079833 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:03:00.080669 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.080156 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/546495c0-daf9-46dd-b67f-89e0fff7fd2d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-fwvlw\" (UID: \"546495c0-daf9-46dd-b67f-89e0fff7fd2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" Jul 09 07:03:00.081862 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.081839 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-ca-trust-extracted\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.082445 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.082425 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e40f8186-5321-4692-8303-24eb101a2fdb-tmp-dir\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:00.082648 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.082625 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-installation-pull-secrets\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.082723 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.082633 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 07:03:00.082723 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.082689 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/546495c0-daf9-46dd-b67f-89e0fff7fd2d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-fwvlw\" (UID: \"546495c0-daf9-46dd-b67f-89e0fff7fd2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" Jul 09 07:03:00.082723 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.082717 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:00.582702102 +0000 UTC m=+36.586373745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : secret "router-metrics-certs-default" not found Jul 09 07:03:00.082900 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.082759 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-serving-cert\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.082967 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.082943 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6966bf5f-cc1f-4c4c-8cdf-5ba57383d978-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gwkcl\" (UID: \"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" Jul 09 07:03:00.083026 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.082966 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01fa2a56-c1cc-4509-b017-989d6363d2cf-cert\") pod \"ingress-canary-h82ff\" (UID: \"01fa2a56-c1cc-4509-b017-989d6363d2cf\") " pod="openshift-ingress-canary/ingress-canary-h82ff" Jul 09 07:03:00.083139 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.083115 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f1db7b2-77fb-4e70-93c3-01ca47c88100-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:00.083449 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.083427 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/023abe38-620c-4d2e-8cf4-990b2b3bc35d-serving-cert\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:00.083964 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.083941 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-trusted-ca\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.084669 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.084649 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-stats-auth\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:00.085562 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.085540 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-default-certificate\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:00.086610 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.086585 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8dnx\" (UniqueName: \"kubernetes.io/projected/01fa2a56-c1cc-4509-b017-989d6363d2cf-kube-api-access-l8dnx\") pod \"ingress-canary-h82ff\" (UID: \"01fa2a56-c1cc-4509-b017-989d6363d2cf\") " pod="openshift-ingress-canary/ingress-canary-h82ff" Jul 09 07:03:00.087552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.087020 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgkww\" (UniqueName: \"kubernetes.io/projected/4f1db7b2-77fb-4e70-93c3-01ca47c88100-kube-api-access-kgkww\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:00.087552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.087088 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b2nx\" (UniqueName: \"kubernetes.io/projected/546495c0-daf9-46dd-b67f-89e0fff7fd2d-kube-api-access-6b2nx\") pod \"kube-storage-version-migrator-operator-846bf668f7-fwvlw\" (UID: \"546495c0-daf9-46dd-b67f-89e0fff7fd2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" Jul 09 07:03:00.088515 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.088140 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-image-registry-private-configuration\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.088515 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.088472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnj25\" (UniqueName: \"kubernetes.io/projected/69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d-kube-api-access-nnj25\") pod \"insights-operator-5c847dcfc4-m5h6q\" (UID: \"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.089458 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.089422 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lpj9\" (UniqueName: \"kubernetes.io/projected/023abe38-620c-4d2e-8cf4-990b2b3bc35d-kube-api-access-7lpj9\") pod \"console-operator-68b757fb67-vnj9j\" (UID: \"023abe38-620c-4d2e-8cf4-990b2b3bc35d\") " pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:00.089870 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.089816 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blmz7\" (UniqueName: \"kubernetes.io/projected/6966bf5f-cc1f-4c4c-8cdf-5ba57383d978-kube-api-access-blmz7\") pod \"service-ca-operator-5d46d9ffd4-gwkcl\" (UID: \"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" Jul 09 07:03:00.090872 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.090441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpmms\" (UniqueName: \"kubernetes.io/projected/e40f8186-5321-4692-8303-24eb101a2fdb-kube-api-access-mpmms\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:00.090872 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.090825 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b9ql\" (UniqueName: \"kubernetes.io/projected/eb8bcf2d-5a87-42e3-a544-293f84ed1a33-kube-api-access-2b9ql\") pod \"volume-data-source-validator-5d456fdbcd-pxmdp\" (UID: \"eb8bcf2d-5a87-42e3-a544-293f84ed1a33\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxmdp" Jul 09 07:03:00.091028 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.090975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-bound-sa-token\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.091527 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.091505 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6pfh\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-kube-api-access-l6pfh\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.092236 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.092212 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd6gm\" (UniqueName: \"kubernetes.io/projected/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-kube-api-access-nd6gm\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:00.092335 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.092220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zl4s\" (UniqueName: \"kubernetes.io/projected/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-kube-api-access-4zl4s\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:03:00.092648 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.092624 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzvh\" (UniqueName: \"kubernetes.io/projected/95c00add-a461-4777-b35b-b9055c31020f-kube-api-access-4kzvh\") pod \"network-check-source-989f8b8dc-6xwd9\" (UID: \"95c00add-a461-4777-b35b-b9055c31020f\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6xwd9" Jul 09 07:03:00.101610 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.101593 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxmdp" Jul 09 07:03:00.137061 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.137027 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" Jul 09 07:03:00.144041 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.143722 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" Jul 09 07:03:00.163161 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.163022 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" Jul 09 07:03:00.168557 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.168488 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6xwd9" Jul 09 07:03:00.174507 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.174305 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:00.180053 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.179874 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h82ff" Jul 09 07:03:00.334178 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.333810 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxmdp"] Jul 09 07:03:00.395620 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.395552 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-m5h6q"] Jul 09 07:03:00.399045 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.398938 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw"] Jul 09 07:03:00.400565 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:00.400413 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f5e4ec_b94a_4d0d_9e4b_ee6763609a9d.slice/crio-6ebf5029ddf6898318b28849f816b9e7d3777cd63de8a553f3c53a76047d29af WatchSource:0}: Error finding container 6ebf5029ddf6898318b28849f816b9e7d3777cd63de8a553f3c53a76047d29af: Status 404 returned error can't find the container with id 6ebf5029ddf6898318b28849f816b9e7d3777cd63de8a553f3c53a76047d29af Jul 09 07:03:00.431346 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:00.431308 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6966bf5f_cc1f_4c4c_8cdf_5ba57383d978.slice/crio-2ac60749400a7fb95118868c71646f32e0c77f08d9fa4c6fb357c0ed62984658 WatchSource:0}: Error finding container 2ac60749400a7fb95118868c71646f32e0c77f08d9fa4c6fb357c0ed62984658: Status 404 returned error can't find the container with id 2ac60749400a7fb95118868c71646f32e0c77f08d9fa4c6fb357c0ed62984658 Jul 09 07:03:00.432267 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.432241 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl"] Jul 09 07:03:00.436458 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.436437 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h82ff"] Jul 09 07:03:00.439460 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.439439 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vnj9j"] Jul 09 07:03:00.440949 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:00.440924 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fa2a56_c1cc_4509_b017_989d6363d2cf.slice/crio-fe557b787dfdad37e57790d3d0e7cc43008e722660ebf893a2a4c2b6dcd6c856 WatchSource:0}: Error finding container fe557b787dfdad37e57790d3d0e7cc43008e722660ebf893a2a4c2b6dcd6c856: Status 404 returned error can't find the container with id fe557b787dfdad37e57790d3d0e7cc43008e722660ebf893a2a4c2b6dcd6c856 Jul 09 07:03:00.441972 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:00.441949 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023abe38_620c_4d2e_8cf4_990b2b3bc35d.slice/crio-c2fc37b9a629685d6af38829fef6c31c02d22bf277c80349f2fb08bc677c86c9 WatchSource:0}: Error finding container c2fc37b9a629685d6af38829fef6c31c02d22bf277c80349f2fb08bc677c86c9: Status 404 returned error can't find the container with id c2fc37b9a629685d6af38829fef6c31c02d22bf277c80349f2fb08bc677c86c9 Jul 09 07:03:00.442063 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.442018 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6xwd9"] Jul 09 07:03:00.444990 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:00.444963 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c00add_a461_4777_b35b_b9055c31020f.slice/crio-84dcfd0afad710281f9f74a1a839cc538d81d907c256bdf6e5fff9c4b8291cf1 WatchSource:0}: Error finding container 84dcfd0afad710281f9f74a1a839cc538d81d907c256bdf6e5fff9c4b8291cf1: Status 404 returned error can't find the container with id 84dcfd0afad710281f9f74a1a839cc538d81d907c256bdf6e5fff9c4b8291cf1 Jul 09 07:03:00.585526 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.585492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.585589 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.585668 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.585724 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.585669 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.585756 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7446669d59-54vd2: secret "image-registry-tls" not found Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.585764 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.585766 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert podName:f62e9f63-ef1f-4906-8a5b-19047a9e69b6 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:01.585723732 +0000 UTC m=+37.589395345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7g8lj" (UID: "f62e9f63-ef1f-4906-8a5b-19047a9e69b6") : secret "networking-console-plugin-cert" not found Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.585823 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls podName:7c6a5609-ef3b-4d4a-8dd0-a03e03217284 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:01.585806857 +0000 UTC m=+37.589478474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls") pod "image-registry-7446669d59-54vd2" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284") : secret "image-registry-tls" not found Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.585848 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls podName:f1a26e1c-41a8-42a9-8b7e-e48383dec2b9 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:01.585838057 +0000 UTC m=+37.589509680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-r6qv7" (UID: "f1a26e1c-41a8-42a9-8b7e-e48383dec2b9") : secret "samples-operator-tls" not found Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.585889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.585916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.585960 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.585957 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.586003 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls podName:e40f8186-5321-4692-8303-24eb101a2fdb nodeName:}" failed. No retries permitted until 2026-07-09 07:03:01.585988398 +0000 UTC m=+37.589660025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls") pod "dns-default-n4z2f" (UID: "e40f8186-5321-4692-8303-24eb101a2fdb") : secret "dns-default-metrics-tls" not found Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.586056 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:00.586391 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.586060 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:01.586040359 +0000 UTC m=+37.589711986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : configmap references non-existent config key: service-ca.crt Jul 09 07:03:00.587094 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.586125 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls podName:4f1db7b2-77fb-4e70-93c3-01ca47c88100 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:01.586107212 +0000 UTC m=+37.589778828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkcw" (UID: "4f1db7b2-77fb-4e70-93c3-01ca47c88100") : secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:00.587094 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.586170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:00.587094 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.586225 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 07:03:00.587094 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:00.586264 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:01.586251373 +0000 UTC m=+37.589923005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : secret "router-metrics-certs-default" not found Jul 09 07:03:00.696186 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.696120 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h82ff" event={"ID":"01fa2a56-c1cc-4509-b017-989d6363d2cf","Type":"ContainerStarted","Data":"fe557b787dfdad37e57790d3d0e7cc43008e722660ebf893a2a4c2b6dcd6c856"} Jul 09 07:03:00.697639 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.697596 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6xwd9" event={"ID":"95c00add-a461-4777-b35b-b9055c31020f","Type":"ContainerStarted","Data":"84dcfd0afad710281f9f74a1a839cc538d81d907c256bdf6e5fff9c4b8291cf1"} Jul 09 07:03:00.698982 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.698954 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxmdp" event={"ID":"eb8bcf2d-5a87-42e3-a544-293f84ed1a33","Type":"ContainerStarted","Data":"992c04b986ff6e2495220fba4e2a266de15c176d7671b67bc269add7f761756b"} Jul 09 07:03:00.702437 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.702412 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" event={"ID":"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d","Type":"ContainerStarted","Data":"6ebf5029ddf6898318b28849f816b9e7d3777cd63de8a553f3c53a76047d29af"} Jul 09 07:03:00.704037 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.704014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" event={"ID":"023abe38-620c-4d2e-8cf4-990b2b3bc35d","Type":"ContainerStarted","Data":"c2fc37b9a629685d6af38829fef6c31c02d22bf277c80349f2fb08bc677c86c9"} Jul 09 07:03:00.705305 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.705281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" event={"ID":"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978","Type":"ContainerStarted","Data":"2ac60749400a7fb95118868c71646f32e0c77f08d9fa4c6fb357c0ed62984658"} Jul 09 07:03:00.706419 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:00.706396 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" event={"ID":"546495c0-daf9-46dd-b67f-89e0fff7fd2d","Type":"ContainerStarted","Data":"7c8974f6dee19141cf545fa380c16871ba379e467fb2e0a212e15aa1c942d4ae"} Jul 09 07:03:01.521024 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.520970 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:03:01.521807 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.521784 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:03:01.522293 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.522274 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:03:01.526698 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.525112 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 07:03:01.526698 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.525361 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h62pq\"" Jul 09 07:03:01.526698 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.525557 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ktp4\"" Jul 09 07:03:01.526698 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.525841 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.596851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.596953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.596984 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.597014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.597064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.597095 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:01.597149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.597309 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.597370 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert podName:f62e9f63-ef1f-4906-8a5b-19047a9e69b6 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:03.597352598 +0000 UTC m=+39.601024225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7g8lj" (UID: "f62e9f63-ef1f-4906-8a5b-19047a9e69b6") : secret "networking-console-plugin-cert" not found Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.597779 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.597796 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7446669d59-54vd2: secret "image-registry-tls" not found Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.597838 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls podName:7c6a5609-ef3b-4d4a-8dd0-a03e03217284 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:03.597824321 +0000 UTC m=+39.601495949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls") pod "image-registry-7446669d59-54vd2" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284") : secret "image-registry-tls" not found Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.597898 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.597929 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls podName:f1a26e1c-41a8-42a9-8b7e-e48383dec2b9 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:03.597919555 +0000 UTC m=+39.601591183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-r6qv7" (UID: "f1a26e1c-41a8-42a9-8b7e-e48383dec2b9") : secret "samples-operator-tls" not found Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.597999 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 07:03:01.598805 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.598040 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls podName:e40f8186-5321-4692-8303-24eb101a2fdb nodeName:}" failed. No retries permitted until 2026-07-09 07:03:03.598018191 +0000 UTC m=+39.601689823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls") pod "dns-default-n4z2f" (UID: "e40f8186-5321-4692-8303-24eb101a2fdb") : secret "dns-default-metrics-tls" not found Jul 09 07:03:01.599942 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.598095 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:01.599942 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.598129 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls podName:4f1db7b2-77fb-4e70-93c3-01ca47c88100 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:03.598119019 +0000 UTC m=+39.601790652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkcw" (UID: "4f1db7b2-77fb-4e70-93c3-01ca47c88100") : secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:01.599942 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.598220 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:03.598207902 +0000 UTC m=+39.601879528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : configmap references non-existent config key: service-ca.crt Jul 09 07:03:01.599942 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.598277 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 07:03:01.599942 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:01.598306 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:03.598297557 +0000 UTC m=+39.601969185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : secret "router-metrics-certs-default" not found Jul 09 07:03:02.721785 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:02.721240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxmdp" event={"ID":"eb8bcf2d-5a87-42e3-a544-293f84ed1a33","Type":"ContainerStarted","Data":"53df232cf230d400e6b017fd557a31b11bc6f8a4d04f07b41e52379a4b4f5c5b"} Jul 09 07:03:02.737698 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:02.736534 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxmdp" podStartSLOduration=38.960184127 podStartE2EDuration="40.736514917s" totalImagesPullingTime="1.77633079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:02.735536255 +0000 UTC m=+38.739207890" watchObservedRunningTime="2026-07-09 07:03:02.736514917 +0000 UTC m=+38.740186552" Jul 09 07:03:03.623008 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:03.622964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:03.623188 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:03.623056 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:03:03.623188 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:03.623086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:03.623188 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:03.623111 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:03.623188 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623136 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 07:03:03.623188 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:03.623151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:03.623188 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623161 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7446669d59-54vd2: secret "image-registry-tls" not found Jul 09 07:03:03.623188 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:03.623182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623222 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623232 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls podName:7c6a5609-ef3b-4d4a-8dd0-a03e03217284 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:07.623209373 +0000 UTC m=+43.626881009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls") pod "image-registry-7446669d59-54vd2" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284") : secret "image-registry-tls" not found Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623285 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:03.623306 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623332 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:07.623316656 +0000 UTC m=+43.626988272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : secret "router-metrics-certs-default" not found Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623376 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623391 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623429 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls podName:f1a26e1c-41a8-42a9-8b7e-e48383dec2b9 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:07.623418928 +0000 UTC m=+43.627090540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-r6qv7" (UID: "f1a26e1c-41a8-42a9-8b7e-e48383dec2b9") : secret "samples-operator-tls" not found Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623447 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert podName:f62e9f63-ef1f-4906-8a5b-19047a9e69b6 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:07.623438045 +0000 UTC m=+43.627109662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7g8lj" (UID: "f62e9f63-ef1f-4906-8a5b-19047a9e69b6") : secret "networking-console-plugin-cert" not found Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623462 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls podName:e40f8186-5321-4692-8303-24eb101a2fdb nodeName:}" failed. No retries permitted until 2026-07-09 07:03:07.623454403 +0000 UTC m=+43.627126023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls") pod "dns-default-n4z2f" (UID: "e40f8186-5321-4692-8303-24eb101a2fdb") : secret "dns-default-metrics-tls" not found Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623478 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:07.623470518 +0000 UTC m=+43.627142179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : configmap references non-existent config key: service-ca.crt Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623507 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:03.623563 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:03.623551 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls podName:4f1db7b2-77fb-4e70-93c3-01ca47c88100 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:07.623534882 +0000 UTC m=+43.627206508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkcw" (UID: "4f1db7b2-77fb-4e70-93c3-01ca47c88100") : secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:07.660073 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:07.660031 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:03:07.660073 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:07.660076 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:07.660104 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:07.660147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:07.660179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:07.660219 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660220 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660284 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660224 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660339 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660341 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660294 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls podName:f1a26e1c-41a8-42a9-8b7e-e48383dec2b9 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:15.660272353 +0000 UTC m=+51.663943966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-r6qv7" (UID: "f1a26e1c-41a8-42a9-8b7e-e48383dec2b9") : secret "samples-operator-tls" not found Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:07.660372 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660386 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:15.660370957 +0000 UTC m=+51.664042590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : secret "router-metrics-certs-default" not found Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660417 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert podName:f62e9f63-ef1f-4906-8a5b-19047a9e69b6 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:15.66040597 +0000 UTC m=+51.664077591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7g8lj" (UID: "f62e9f63-ef1f-4906-8a5b-19047a9e69b6") : secret "networking-console-plugin-cert" not found Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660431 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660436 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls podName:4f1db7b2-77fb-4e70-93c3-01ca47c88100 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:15.660427054 +0000 UTC m=+51.664098673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkcw" (UID: "4f1db7b2-77fb-4e70-93c3-01ca47c88100") : secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:07.660669 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660443 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7446669d59-54vd2: secret "image-registry-tls" not found Jul 09 07:03:07.661299 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660453 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls podName:e40f8186-5321-4692-8303-24eb101a2fdb nodeName:}" failed. No retries permitted until 2026-07-09 07:03:15.660444714 +0000 UTC m=+51.664116332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls") pod "dns-default-n4z2f" (UID: "e40f8186-5321-4692-8303-24eb101a2fdb") : secret "dns-default-metrics-tls" not found Jul 09 07:03:07.661299 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660471 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:15.660462257 +0000 UTC m=+51.664133870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : configmap references non-existent config key: service-ca.crt Jul 09 07:03:07.661299 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:07.660486 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls podName:7c6a5609-ef3b-4d4a-8dd0-a03e03217284 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:15.660478488 +0000 UTC m=+51.664150104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls") pod "image-registry-7446669d59-54vd2" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284") : secret "image-registry-tls" not found Jul 09 07:03:10.747196 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.747155 2565 generic.go:356] "Generic (PLEG): container finished" podID="c42f0c2b-8932-4145-afb2-385537ef8b4c" containerID="9b572ff3bbc48ef6acd5d2438d525033173988a9af5ce59144899024d092a379" exitCode=0 Jul 09 07:03:10.747718 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.747246 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lc7j" event={"ID":"c42f0c2b-8932-4145-afb2-385537ef8b4c","Type":"ContainerDied","Data":"9b572ff3bbc48ef6acd5d2438d525033173988a9af5ce59144899024d092a379"} Jul 09 07:03:10.749449 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.749387 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" event={"ID":"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d","Type":"ContainerStarted","Data":"04f64724fd3f73c2cfcd82d166579e2324e7068db9cf14f114976f8251c53e37"} Jul 09 07:03:10.751591 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.751491 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/0.log" Jul 09 07:03:10.751591 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.751531 2565 generic.go:356] "Generic (PLEG): container finished" podID="023abe38-620c-4d2e-8cf4-990b2b3bc35d" containerID="46d5cb3e4479ee59872d81ee71c346ca98a20a0a2067de2094ef8064078ce5c8" exitCode=255 Jul 09 07:03:10.751701 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.751618 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" event={"ID":"023abe38-620c-4d2e-8cf4-990b2b3bc35d","Type":"ContainerDied","Data":"46d5cb3e4479ee59872d81ee71c346ca98a20a0a2067de2094ef8064078ce5c8"} Jul 09 07:03:10.751895 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.751877 2565 scope.go:117] "RemoveContainer" containerID="46d5cb3e4479ee59872d81ee71c346ca98a20a0a2067de2094ef8064078ce5c8" Jul 09 07:03:10.759081 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.759057 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" event={"ID":"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978","Type":"ContainerStarted","Data":"990e26e51acbb6051a94c423ae185fb03fccf08f75b6cbc0c3d1e4830cdac2d3"} Jul 09 07:03:10.760788 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.760759 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" event={"ID":"546495c0-daf9-46dd-b67f-89e0fff7fd2d","Type":"ContainerStarted","Data":"38d6e76059e774987ef97d01626021e7572daf2c91246bb5410fb83cfe560718"} Jul 09 07:03:10.762498 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.762475 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h82ff" event={"ID":"01fa2a56-c1cc-4509-b017-989d6363d2cf","Type":"ContainerStarted","Data":"e7b42b69f817857cf3b0bdcd0c931e7e18db6334674c368f7fa976d82f9c05c1"} Jul 09 07:03:10.763931 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.763908 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6xwd9" event={"ID":"95c00add-a461-4777-b35b-b9055c31020f","Type":"ContainerStarted","Data":"f05210c209206f323fa87ef15c57ac495f95f562bbcf7c73973d43dfb678b752"} Jul 09 07:03:10.787387 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.787332 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" podStartSLOduration=38.977323447 podStartE2EDuration="48.787313543s" totalImagesPullingTime="9.809990096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:10.786263319 +0000 UTC m=+46.789934957" watchObservedRunningTime="2026-07-09 07:03:10.787313543 +0000 UTC m=+46.790985181" Jul 09 07:03:10.822206 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.822146 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" podStartSLOduration=39.040369663 podStartE2EDuration="48.822125775s" totalImagesPullingTime="9.781756112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:10.820929864 +0000 UTC m=+46.824601500" watchObservedRunningTime="2026-07-09 07:03:10.822125775 +0000 UTC m=+46.825797411" Jul 09 07:03:10.861139 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.861060 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6xwd9" podStartSLOduration=39.083452472 podStartE2EDuration="48.861014411s" totalImagesPullingTime="9.777561939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:10.840449837 +0000 UTC m=+46.844121474" watchObservedRunningTime="2026-07-09 07:03:10.861014411 +0000 UTC m=+46.864686047" Jul 09 07:03:10.861520 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.861463 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h82ff" podStartSLOduration=2.089573408 podStartE2EDuration="11.861453103s" totalImagesPullingTime="9.771879695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:10.859858618 +0000 UTC m=+46.863530253" watchObservedRunningTime="2026-07-09 07:03:10.861453103 +0000 UTC m=+46.865124739" Jul 09 07:03:10.886864 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:10.886814 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" podStartSLOduration=39.076692175 podStartE2EDuration="48.886794793s" totalImagesPullingTime="9.810102618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:10.884787863 +0000 UTC m=+46.888459499" watchObservedRunningTime="2026-07-09 07:03:10.886794793 +0000 UTC m=+46.890466429" Jul 09 07:03:11.771895 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:11.771854 2565 generic.go:356] "Generic (PLEG): container finished" podID="c42f0c2b-8932-4145-afb2-385537ef8b4c" containerID="4beb72acdad6d2194d400ab0e47d29c46b6a143f72d870ee895a8331a835dd74" exitCode=0 Jul 09 07:03:11.772341 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:11.771945 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lc7j" event={"ID":"c42f0c2b-8932-4145-afb2-385537ef8b4c","Type":"ContainerDied","Data":"4beb72acdad6d2194d400ab0e47d29c46b6a143f72d870ee895a8331a835dd74"} Jul 09 07:03:11.773752 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:11.773705 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:03:11.774261 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:11.774198 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/0.log" Jul 09 07:03:11.774359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:11.774284 2565 generic.go:356] "Generic (PLEG): container finished" podID="023abe38-620c-4d2e-8cf4-990b2b3bc35d" containerID="482bf9ddde42c2fce68555a8bb636581791e52ff074736ce1f34bf834986bdf9" exitCode=255 Jul 09 07:03:11.774418 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:11.774384 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" event={"ID":"023abe38-620c-4d2e-8cf4-990b2b3bc35d","Type":"ContainerDied","Data":"482bf9ddde42c2fce68555a8bb636581791e52ff074736ce1f34bf834986bdf9"} Jul 09 07:03:11.774471 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:11.774440 2565 scope.go:117] "RemoveContainer" containerID="46d5cb3e4479ee59872d81ee71c346ca98a20a0a2067de2094ef8064078ce5c8" Jul 09 07:03:11.775979 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:11.775962 2565 scope.go:117] "RemoveContainer" containerID="482bf9ddde42c2fce68555a8bb636581791e52ff074736ce1f34bf834986bdf9" Jul 09 07:03:11.776333 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:11.776125 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vnj9j_openshift-console-operator(023abe38-620c-4d2e-8cf4-990b2b3bc35d)\"" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" podUID="023abe38-620c-4d2e-8cf4-990b2b3bc35d" Jul 09 07:03:12.781878 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:12.781831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lc7j" event={"ID":"c42f0c2b-8932-4145-afb2-385537ef8b4c","Type":"ContainerStarted","Data":"b0c7eb0bffa5c0a42196e6d3b543047c710f204d53e54907a2f11dbe636bf7b8"} Jul 09 07:03:12.783337 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:12.783314 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:03:12.783614 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:12.783600 2565 scope.go:117] "RemoveContainer" containerID="482bf9ddde42c2fce68555a8bb636581791e52ff074736ce1f34bf834986bdf9" Jul 09 07:03:12.783767 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:12.783750 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vnj9j_openshift-console-operator(023abe38-620c-4d2e-8cf4-990b2b3bc35d)\"" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" podUID="023abe38-620c-4d2e-8cf4-990b2b3bc35d" Jul 09 07:03:12.803024 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:12.802975 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8lc7j" podStartSLOduration=8.906290895 podStartE2EDuration="47.80296006s" totalImagesPullingTime="38.896669165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:12.800988646 +0000 UTC m=+48.804660281" watchObservedRunningTime="2026-07-09 07:03:12.80296006 +0000 UTC m=+48.806631695" Jul 09 07:03:13.128413 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.128380 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zb5qf"] Jul 09 07:03:13.143938 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.143904 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zb5qf"] Jul 09 07:03:13.144190 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.144038 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.146595 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.146562 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 07:03:13.146716 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.146701 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rfq8r\"" Jul 09 07:03:13.147084 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.147059 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 07:03:13.220487 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.220452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.220645 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.220513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fwjk\" (UniqueName: \"kubernetes.io/projected/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-api-access-8fwjk\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.220645 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.220617 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67b7f45a-88af-4a28-af89-864b69fc0da1-data-volume\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.220753 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.220674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67b7f45a-88af-4a28-af89-864b69fc0da1-crio-socket\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.220753 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.220702 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.321411 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.321374 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fwjk\" (UniqueName: \"kubernetes.io/projected/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-api-access-8fwjk\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.321619 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.321437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67b7f45a-88af-4a28-af89-864b69fc0da1-data-volume\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.321619 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.321483 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67b7f45a-88af-4a28-af89-864b69fc0da1-crio-socket\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.321619 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.321504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.321619 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:13.321572 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 07:03:13.321847 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:13.321629 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm podName:67b7f45a-88af-4a28-af89-864b69fc0da1 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:13.821611327 +0000 UTC m=+49.825282958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb5qf" (UID: "67b7f45a-88af-4a28-af89-864b69fc0da1") : configmap "kube-rbac-proxy" not found Jul 09 07:03:13.321847 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.321688 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67b7f45a-88af-4a28-af89-864b69fc0da1-crio-socket\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.321847 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.321699 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.321847 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:13.321786 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 07:03:13.321847 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:13.321824 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls podName:67b7f45a-88af-4a28-af89-864b69fc0da1 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:13.821812508 +0000 UTC m=+49.825484160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb5qf" (UID: "67b7f45a-88af-4a28-af89-864b69fc0da1") : secret "insights-runtime-extractor-tls" not found Jul 09 07:03:13.321847 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.321819 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67b7f45a-88af-4a28-af89-864b69fc0da1-data-volume\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.332015 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.331987 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fwjk\" (UniqueName: \"kubernetes.io/projected/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-api-access-8fwjk\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.826533 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.826495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.826968 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:13.826622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:13.826968 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:13.826650 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 07:03:13.826968 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:13.826714 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls podName:67b7f45a-88af-4a28-af89-864b69fc0da1 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:14.826699163 +0000 UTC m=+50.830370779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb5qf" (UID: "67b7f45a-88af-4a28-af89-864b69fc0da1") : secret "insights-runtime-extractor-tls" not found Jul 09 07:03:13.826968 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:13.826775 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 07:03:13.826968 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:13.826826 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm podName:67b7f45a-88af-4a28-af89-864b69fc0da1 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:14.826813473 +0000 UTC m=+50.830485085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb5qf" (UID: "67b7f45a-88af-4a28-af89-864b69fc0da1") : configmap "kube-rbac-proxy" not found Jul 09 07:03:14.836187 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:14.836145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:14.836597 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:14.836252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:14.836597 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:14.836274 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 07:03:14.836597 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:14.836338 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm podName:67b7f45a-88af-4a28-af89-864b69fc0da1 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:16.836318146 +0000 UTC m=+52.839989776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb5qf" (UID: "67b7f45a-88af-4a28-af89-864b69fc0da1") : configmap "kube-rbac-proxy" not found Jul 09 07:03:14.836597 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:14.836356 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 07:03:14.836597 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:14.836402 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls podName:67b7f45a-88af-4a28-af89-864b69fc0da1 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:16.836391568 +0000 UTC m=+52.840063181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb5qf" (UID: "67b7f45a-88af-4a28-af89-864b69fc0da1") : secret "insights-runtime-extractor-tls" not found Jul 09 07:03:15.710324 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:15.710300 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j8fml_8ec102ca-2f18-441e-bd65-8aaf7a925887/dns-node-resolver/0.log" Jul 09 07:03:15.746134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:15.746090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:15.746291 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:15.746151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:15.746291 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:15.746188 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:03:15.746291 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746263 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:31.746241334 +0000 UTC m=+67.749912982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : configmap references non-existent config key: service-ca.crt Jul 09 07:03:15.746441 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:15.746302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:15.746441 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746319 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 07:03:15.746441 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:15.746364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:03:15.746441 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746389 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert podName:f62e9f63-ef1f-4906-8a5b-19047a9e69b6 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:31.746376861 +0000 UTC m=+67.750048477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7g8lj" (UID: "f62e9f63-ef1f-4906-8a5b-19047a9e69b6") : secret "networking-console-plugin-cert" not found Jul 09 07:03:15.746441 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746319 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 07:03:15.746441 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:15.746420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:15.746441 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746443 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 07:03:15.746679 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746448 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 07:03:15.746679 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746466 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7446669d59-54vd2: secret "image-registry-tls" not found Jul 09 07:03:15.746679 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746484 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 07:03:15.746679 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746446 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs podName:62bc8364-fc00-42b4-8e18-e5c30b3fbb15 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:31.746434264 +0000 UTC m=+67.750105904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs") pod "router-default-7f48c84f45-4pdpl" (UID: "62bc8364-fc00-42b4-8e18-e5c30b3fbb15") : secret "router-metrics-certs-default" not found Jul 09 07:03:15.746679 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:15.746537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:15.746679 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746594 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:15.746679 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746616 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls podName:f1a26e1c-41a8-42a9-8b7e-e48383dec2b9 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:31.746602639 +0000 UTC m=+67.750274261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-r6qv7" (UID: "f1a26e1c-41a8-42a9-8b7e-e48383dec2b9") : secret "samples-operator-tls" not found Jul 09 07:03:15.746679 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746636 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls podName:e40f8186-5321-4692-8303-24eb101a2fdb nodeName:}" failed. No retries permitted until 2026-07-09 07:03:31.746624768 +0000 UTC m=+67.750296383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls") pod "dns-default-n4z2f" (UID: "e40f8186-5321-4692-8303-24eb101a2fdb") : secret "dns-default-metrics-tls" not found Jul 09 07:03:15.746679 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746653 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls podName:7c6a5609-ef3b-4d4a-8dd0-a03e03217284 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:31.746647477 +0000 UTC m=+67.750319091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls") pod "image-registry-7446669d59-54vd2" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284") : secret "image-registry-tls" not found Jul 09 07:03:15.746679 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:15.746665 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls podName:4f1db7b2-77fb-4e70-93c3-01ca47c88100 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:31.746660755 +0000 UTC m=+67.750332368 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkcw" (UID: "4f1db7b2-77fb-4e70-93c3-01ca47c88100") : secret "cluster-monitoring-operator-tls" not found Jul 09 07:03:16.857592 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:16.857537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:16.858023 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:16.857686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:16.858023 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:16.857693 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 07:03:16.858023 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:16.857767 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls podName:67b7f45a-88af-4a28-af89-864b69fc0da1 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:20.857752613 +0000 UTC m=+56.861424227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb5qf" (UID: "67b7f45a-88af-4a28-af89-864b69fc0da1") : secret "insights-runtime-extractor-tls" not found Jul 09 07:03:16.858023 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:16.857799 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 07:03:16.858023 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:16.857867 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm podName:67b7f45a-88af-4a28-af89-864b69fc0da1 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:20.857852585 +0000 UTC m=+56.861524209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb5qf" (UID: "67b7f45a-88af-4a28-af89-864b69fc0da1") : configmap "kube-rbac-proxy" not found Jul 09 07:03:17.110124 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:17.110046 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rjps9_60fb5c1d-e3d7-4d4c-b356-58ff313ae286/node-ca/0.log" Jul 09 07:03:17.910362 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:17.910335 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h82ff_01fa2a56-c1cc-4509-b017-989d6363d2cf/serve-healthcheck-canary/0.log" Jul 09 07:03:18.512462 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:18.512414 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-fwvlw_546495c0-daf9-46dd-b67f-89e0fff7fd2d/kube-storage-version-migrator-operator/0.log" Jul 09 07:03:20.175546 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:20.175504 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:20.175961 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:20.175579 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:20.175961 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:20.175958 2565 scope.go:117] "RemoveContainer" containerID="482bf9ddde42c2fce68555a8bb636581791e52ff074736ce1f34bf834986bdf9" Jul 09 07:03:20.176153 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:20.176130 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vnj9j_openshift-console-operator(023abe38-620c-4d2e-8cf4-990b2b3bc35d)\"" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" podUID="023abe38-620c-4d2e-8cf4-990b2b3bc35d" Jul 09 07:03:20.892343 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:20.892310 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:20.892527 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:20.892437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:20.892527 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:20.892468 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 07:03:20.892612 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:20.892547 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls podName:67b7f45a-88af-4a28-af89-864b69fc0da1 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:28.892532022 +0000 UTC m=+64.896203640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb5qf" (UID: "67b7f45a-88af-4a28-af89-864b69fc0da1") : secret "insights-runtime-extractor-tls" not found Jul 09 07:03:20.892612 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:20.892546 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 07:03:20.892612 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:03:20.892576 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm podName:67b7f45a-88af-4a28-af89-864b69fc0da1 nodeName:}" failed. No retries permitted until 2026-07-09 07:03:28.892570073 +0000 UTC m=+64.896241686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb5qf" (UID: "67b7f45a-88af-4a28-af89-864b69fc0da1") : configmap "kube-rbac-proxy" not found Jul 09 07:03:26.692686 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:26.692653 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cz6gt" Jul 09 07:03:28.969610 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:28.969567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:28.970153 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:28.969778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:28.970311 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:28.970286 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67b7f45a-88af-4a28-af89-864b69fc0da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:28.972128 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:28.972109 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67b7f45a-88af-4a28-af89-864b69fc0da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb5qf\" (UID: \"67b7f45a-88af-4a28-af89-864b69fc0da1\") " pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:29.055496 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:29.055464 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rfq8r\"" Jul 09 07:03:29.064192 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:29.064172 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zb5qf" Jul 09 07:03:29.188835 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:29.188813 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zb5qf"] Jul 09 07:03:29.191306 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:29.191278 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b7f45a_88af_4a28_af89_864b69fc0da1.slice/crio-f0455e5e570db7df10723ee64957c793257b2237b8cef300fd18abf7777be6c2 WatchSource:0}: Error finding container f0455e5e570db7df10723ee64957c793257b2237b8cef300fd18abf7777be6c2: Status 404 returned error can't find the container with id f0455e5e570db7df10723ee64957c793257b2237b8cef300fd18abf7777be6c2 Jul 09 07:03:29.841218 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:29.841177 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb5qf" event={"ID":"67b7f45a-88af-4a28-af89-864b69fc0da1","Type":"ContainerStarted","Data":"f0455e5e570db7df10723ee64957c793257b2237b8cef300fd18abf7777be6c2"} Jul 09 07:03:30.181080 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.180985 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:03:30.183464 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.183444 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 07:03:30.193601 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.193582 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31b9f6a6-e642-410d-8e01-975cace6de3b-original-pull-secret\") pod \"global-pull-secret-syncer-xbl78\" (UID: \"31b9f6a6-e642-410d-8e01-975cace6de3b\") " pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:03:30.281582 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.281536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:03:30.283990 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.283971 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 07:03:30.294117 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.294094 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6a9e1-c301-4acf-bd85-6611426f243b-metrics-certs\") pod \"network-metrics-daemon-25zcm\" (UID: \"25b6a9e1-c301-4acf-bd85-6611426f243b\") " pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:03:30.340202 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.340173 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h62pq\"" Jul 09 07:03:30.348210 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.348193 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zcm" Jul 09 07:03:30.356788 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.356770 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbl78" Jul 09 07:03:30.382460 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.382425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7bq\" (UniqueName: \"kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq\") pod \"network-check-target-6qdt7\" (UID: \"bef75bae-f333-40b5-ac37-d89c07c499c0\") " pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:03:30.384862 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.384841 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r7bq\" (UniqueName: \"kubernetes.io/projected/bef75bae-f333-40b5-ac37-d89c07c499c0-kube-api-access-6r7bq\") pod \"network-check-target-6qdt7\" (UID: \"bef75bae-f333-40b5-ac37-d89c07c499c0\") " pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:03:30.477034 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.477007 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-25zcm"] Jul 09 07:03:30.480157 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:30.480126 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b6a9e1_c301_4acf_bd85_6611426f243b.slice/crio-6d5d9ebff4c788bafe83fd43c02025886688550295808047661721b3796f3290 WatchSource:0}: Error finding container 6d5d9ebff4c788bafe83fd43c02025886688550295808047661721b3796f3290: Status 404 returned error can't find the container with id 6d5d9ebff4c788bafe83fd43c02025886688550295808047661721b3796f3290 Jul 09 07:03:30.494345 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.494303 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xbl78"] Jul 09 07:03:30.497086 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:30.497063 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b9f6a6_e642_410d_8e01_975cace6de3b.slice/crio-435c9254933afce95224a58b067650479115a76fa30621f89a1d8ce724c486e5 WatchSource:0}: Error finding container 435c9254933afce95224a58b067650479115a76fa30621f89a1d8ce724c486e5: Status 404 returned error can't find the container with id 435c9254933afce95224a58b067650479115a76fa30621f89a1d8ce724c486e5 Jul 09 07:03:30.651986 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.651958 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ktp4\"" Jul 09 07:03:30.660714 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.660687 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:03:30.780473 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.780442 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6qdt7"] Jul 09 07:03:30.783686 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:30.783660 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef75bae_f333_40b5_ac37_d89c07c499c0.slice/crio-a72f2578c03726def017c1e8230b1994e9b78b61dd0abf5665f5c38e48b9613d WatchSource:0}: Error finding container a72f2578c03726def017c1e8230b1994e9b78b61dd0abf5665f5c38e48b9613d: Status 404 returned error can't find the container with id a72f2578c03726def017c1e8230b1994e9b78b61dd0abf5665f5c38e48b9613d Jul 09 07:03:30.847928 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.847893 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6qdt7" event={"ID":"bef75bae-f333-40b5-ac37-d89c07c499c0","Type":"ContainerStarted","Data":"db3311f6bf7f7c9919f42dfde6c3394482bdfee5fe30d56f49b1d08a0fb24238"} Jul 09 07:03:30.848059 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.847952 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6qdt7" event={"ID":"bef75bae-f333-40b5-ac37-d89c07c499c0","Type":"ContainerStarted","Data":"a72f2578c03726def017c1e8230b1994e9b78b61dd0abf5665f5c38e48b9613d"} Jul 09 07:03:30.848059 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.847990 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:03:30.849232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.849208 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xbl78" event={"ID":"31b9f6a6-e642-410d-8e01-975cace6de3b","Type":"ContainerStarted","Data":"435c9254933afce95224a58b067650479115a76fa30621f89a1d8ce724c486e5"} Jul 09 07:03:30.850348 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.850324 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25zcm" event={"ID":"25b6a9e1-c301-4acf-bd85-6611426f243b","Type":"ContainerStarted","Data":"6d5d9ebff4c788bafe83fd43c02025886688550295808047661721b3796f3290"} Jul 09 07:03:30.862981 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:30.862938 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6qdt7" podStartSLOduration=65.862924786 podStartE2EDuration="1m5.862924786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:30.86140475 +0000 UTC m=+66.865076386" watchObservedRunningTime="2026-07-09 07:03:30.862924786 +0000 UTC m=+66.866596422" Jul 09 07:03:31.795289 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.795258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:03:31.795654 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.795331 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:31.795654 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.795388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:03:31.795654 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.795418 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:31.795654 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.795450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:31.795654 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.795493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:31.795654 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.795526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:31.797035 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.796954 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-service-ca-bundle\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:31.803490 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.803460 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e40f8186-5321-4692-8303-24eb101a2fdb-metrics-tls\") pod \"dns-default-n4z2f\" (UID: \"e40f8186-5321-4692-8303-24eb101a2fdb\") " pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:31.804510 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.804486 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bc8364-fc00-42b4-8e18-e5c30b3fbb15-metrics-certs\") pod \"router-default-7f48c84f45-4pdpl\" (UID: \"62bc8364-fc00-42b4-8e18-e5c30b3fbb15\") " pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:31.806095 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.806069 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62e9f63-ef1f-4906-8a5b-19047a9e69b6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7g8lj\" (UID: \"f62e9f63-ef1f-4906-8a5b-19047a9e69b6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:03:31.807197 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.807174 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1a26e1c-41a8-42a9-8b7e-e48383dec2b9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-r6qv7\" (UID: \"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:03:31.808168 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.808143 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f1db7b2-77fb-4e70-93c3-01ca47c88100-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkcw\" (UID: \"4f1db7b2-77fb-4e70-93c3-01ca47c88100\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:31.811545 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.811517 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls\") pod \"image-registry-7446669d59-54vd2\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:31.914074 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.914038 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5gtzk\"" Jul 09 07:03:31.922158 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.921946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" Jul 09 07:03:31.922894 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.922870 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lg8gc\"" Jul 09 07:03:31.931559 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.931511 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:31.932298 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.932106 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9rb85\"" Jul 09 07:03:31.940850 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.940807 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" Jul 09 07:03:31.956418 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.956134 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z7kjk\"" Jul 09 07:03:31.958672 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.958497 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w89gz\"" Jul 09 07:03:31.961359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.961185 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:31.967911 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.967712 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" Jul 09 07:03:31.990193 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:31.990162 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k8zmf\"" Jul 09 07:03:32.001514 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.001479 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:32.140801 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.140702 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7"] Jul 09 07:03:32.200281 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.200247 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f48c84f45-4pdpl"] Jul 09 07:03:32.244483 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.241552 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw"] Jul 09 07:03:32.249014 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.247980 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7446669d59-54vd2"] Jul 09 07:03:32.255426 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:32.255398 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1db7b2_77fb_4e70_93c3_01ca47c88100.slice/crio-dca75d6e5782ffe7e28961e6d78db25f7d058d5dec0ffcbee8b3da07398ac547 WatchSource:0}: Error finding container dca75d6e5782ffe7e28961e6d78db25f7d058d5dec0ffcbee8b3da07398ac547: Status 404 returned error can't find the container with id dca75d6e5782ffe7e28961e6d78db25f7d058d5dec0ffcbee8b3da07398ac547 Jul 09 07:03:32.256063 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:32.255836 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6a5609_ef3b_4d4a_8dd0_a03e03217284.slice/crio-56a18e1d52e434ddb291bf93c1ac349e7548951f32b0abbae28580d8fbfa378a WatchSource:0}: Error finding container 56a18e1d52e434ddb291bf93c1ac349e7548951f32b0abbae28580d8fbfa378a: Status 404 returned error can't find the container with id 56a18e1d52e434ddb291bf93c1ac349e7548951f32b0abbae28580d8fbfa378a Jul 09 07:03:32.273929 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.273819 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj"] Jul 09 07:03:32.276698 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:32.276662 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf62e9f63_ef1f_4906_8a5b_19047a9e69b6.slice/crio-0bb35591fe44f3cab11da411cad167966afc7e00fbf15c7a94163e2df10f5abe WatchSource:0}: Error finding container 0bb35591fe44f3cab11da411cad167966afc7e00fbf15c7a94163e2df10f5abe: Status 404 returned error can't find the container with id 0bb35591fe44f3cab11da411cad167966afc7e00fbf15c7a94163e2df10f5abe Jul 09 07:03:32.295270 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.295238 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4z2f"] Jul 09 07:03:32.305373 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:32.305341 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40f8186_5321_4692_8303_24eb101a2fdb.slice/crio-b82f8001b80538bb08bfed37d02773d290f4e77ea2efebd58c90bf9ce63f0f2a WatchSource:0}: Error finding container b82f8001b80538bb08bfed37d02773d290f4e77ea2efebd58c90bf9ce63f0f2a: Status 404 returned error can't find the container with id b82f8001b80538bb08bfed37d02773d290f4e77ea2efebd58c90bf9ce63f0f2a Jul 09 07:03:32.863897 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.863849 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" event={"ID":"f62e9f63-ef1f-4906-8a5b-19047a9e69b6","Type":"ContainerStarted","Data":"0bb35591fe44f3cab11da411cad167966afc7e00fbf15c7a94163e2df10f5abe"} Jul 09 07:03:32.867274 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.867148 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7446669d59-54vd2" event={"ID":"7c6a5609-ef3b-4d4a-8dd0-a03e03217284","Type":"ContainerStarted","Data":"5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b"} Jul 09 07:03:32.867274 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.867209 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7446669d59-54vd2" event={"ID":"7c6a5609-ef3b-4d4a-8dd0-a03e03217284","Type":"ContainerStarted","Data":"56a18e1d52e434ddb291bf93c1ac349e7548951f32b0abbae28580d8fbfa378a"} Jul 09 07:03:32.867274 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.867242 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:32.868728 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.868695 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" event={"ID":"4f1db7b2-77fb-4e70-93c3-01ca47c88100","Type":"ContainerStarted","Data":"dca75d6e5782ffe7e28961e6d78db25f7d058d5dec0ffcbee8b3da07398ac547"} Jul 09 07:03:32.870435 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.870175 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" event={"ID":"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9","Type":"ContainerStarted","Data":"30c0b4fedffb9d7bef1ad3d086f6774afae526f5b4aa03cfe12b298a93d835ee"} Jul 09 07:03:32.872886 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.872858 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f48c84f45-4pdpl" event={"ID":"62bc8364-fc00-42b4-8e18-e5c30b3fbb15","Type":"ContainerStarted","Data":"8f99ad6a7d8e61e0c45a866c1da16b2494896b31b0092de6264b03dde9a1ca59"} Jul 09 07:03:32.872977 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.872908 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f48c84f45-4pdpl" event={"ID":"62bc8364-fc00-42b4-8e18-e5c30b3fbb15","Type":"ContainerStarted","Data":"3a339a34c74bb401c7ac3b05815f0ffa0d4aca2ffa470467b416720898665d64"} Jul 09 07:03:32.876631 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.876606 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25zcm" event={"ID":"25b6a9e1-c301-4acf-bd85-6611426f243b","Type":"ContainerStarted","Data":"1f25bb5cda3df42dee3d8541b7ab8e03d05252263205f533c66e2fa4b63af63d"} Jul 09 07:03:32.876725 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.876656 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25zcm" event={"ID":"25b6a9e1-c301-4acf-bd85-6611426f243b","Type":"ContainerStarted","Data":"70c017e12bbab48c5e201af359c83ee6258d31f86daf44554483a26fb9bc6843"} Jul 09 07:03:32.878406 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.878385 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4z2f" event={"ID":"e40f8186-5321-4692-8303-24eb101a2fdb","Type":"ContainerStarted","Data":"b82f8001b80538bb08bfed37d02773d290f4e77ea2efebd58c90bf9ce63f0f2a"} Jul 09 07:03:32.903914 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.903863 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7446669d59-54vd2" podStartSLOduration=70.903846876 podStartE2EDuration="1m10.903846876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:32.885768011 +0000 UTC m=+68.889439647" watchObservedRunningTime="2026-07-09 07:03:32.903846876 +0000 UTC m=+68.907518512" Jul 09 07:03:32.904237 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.904213 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7f48c84f45-4pdpl" podStartSLOduration=70.904204954 podStartE2EDuration="1m10.904204954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:32.902133003 +0000 UTC m=+68.905804641" watchObservedRunningTime="2026-07-09 07:03:32.904204954 +0000 UTC m=+68.907876589" Jul 09 07:03:32.916938 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.916877 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-25zcm" podStartSLOduration=66.60609126 podStartE2EDuration="1m7.916857959s" totalImagesPullingTime="1.310766699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:32.915500254 +0000 UTC m=+68.919171890" watchObservedRunningTime="2026-07-09 07:03:32.916857959 +0000 UTC m=+68.920529595" Jul 09 07:03:32.932027 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.931992 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:32.935463 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:32.935438 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:33.521581 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:33.521546 2565 scope.go:117] "RemoveContainer" containerID="482bf9ddde42c2fce68555a8bb636581791e52ff074736ce1f34bf834986bdf9" Jul 09 07:03:33.883114 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:33.883084 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:33.884674 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:33.884650 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f48c84f45-4pdpl" Jul 09 07:03:37.901574 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:37.901512 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xbl78" event={"ID":"31b9f6a6-e642-410d-8e01-975cace6de3b","Type":"ContainerStarted","Data":"211c019f00095231a24e024933c666be87f7c4079d689b0ba385f581b0732472"} Jul 09 07:03:37.907691 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:37.907653 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" event={"ID":"4f1db7b2-77fb-4e70-93c3-01ca47c88100","Type":"ContainerStarted","Data":"521b721c69869163e2f77ea37a780c48c5e025b451875e225c8a075c02dce866"} Jul 09 07:03:37.913768 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:37.913415 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:03:37.913768 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:37.913462 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" event={"ID":"023abe38-620c-4d2e-8cf4-990b2b3bc35d","Type":"ContainerStarted","Data":"c92c4bae4d80b9d2f3782f8d739e5b0b20c83642e3de71f72e3300146a79c5d0"} Jul 09 07:03:37.914345 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:37.914293 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:37.919885 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:37.918903 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xbl78" podStartSLOduration=66.02658092 podStartE2EDuration="1m12.918879877s" totalImagesPullingTime="6.892298957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:37.918027777 +0000 UTC m=+73.921699414" watchObservedRunningTime="2026-07-09 07:03:37.918879877 +0000 UTC m=+73.922551512" Jul 09 07:03:37.921491 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:37.921446 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" Jul 09 07:03:37.944166 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:37.943898 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkcw" podStartSLOduration=70.81127449 podStartE2EDuration="1m15.943878305s" totalImagesPullingTime="5.132603815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:37.942081825 +0000 UTC m=+73.945753461" watchObservedRunningTime="2026-07-09 07:03:37.943878305 +0000 UTC m=+73.947549945" Jul 09 07:03:37.965637 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:37.965604 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-qxfxl"] Jul 09 07:03:37.975256 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:37.975184 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-vnj9j" podStartSLOduration=66.203809422 podStartE2EDuration="1m15.975162463s" totalImagesPullingTime="9.771353041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:37.974011122 +0000 UTC m=+73.977682759" watchObservedRunningTime="2026-07-09 07:03:37.975162463 +0000 UTC m=+73.978834099" Jul 09 07:03:38.022279 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:38.022232 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-qxfxl"] Jul 09 07:03:38.022448 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:38.022365 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-qxfxl" Jul 09 07:03:38.024802 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:38.024766 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 07:03:38.024977 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:38.024807 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-t48tf\"" Jul 09 07:03:38.025107 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:38.025089 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 07:03:38.147499 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:38.147457 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmf7q\" (UniqueName: \"kubernetes.io/projected/d1147087-94cd-4db1-b695-512accd102f7-kube-api-access-qmf7q\") pod \"downloads-685bfb5f64-qxfxl\" (UID: \"d1147087-94cd-4db1-b695-512accd102f7\") " pod="openshift-console/downloads-685bfb5f64-qxfxl" Jul 09 07:03:38.248491 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:38.248392 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmf7q\" (UniqueName: \"kubernetes.io/projected/d1147087-94cd-4db1-b695-512accd102f7-kube-api-access-qmf7q\") pod \"downloads-685bfb5f64-qxfxl\" (UID: \"d1147087-94cd-4db1-b695-512accd102f7\") " pod="openshift-console/downloads-685bfb5f64-qxfxl" Jul 09 07:03:38.257044 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:38.257005 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmf7q\" (UniqueName: \"kubernetes.io/projected/d1147087-94cd-4db1-b695-512accd102f7-kube-api-access-qmf7q\") pod \"downloads-685bfb5f64-qxfxl\" (UID: \"d1147087-94cd-4db1-b695-512accd102f7\") " pod="openshift-console/downloads-685bfb5f64-qxfxl" Jul 09 07:03:38.334175 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:38.334132 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-qxfxl" Jul 09 07:03:39.850611 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:39.850461 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-qxfxl"] Jul 09 07:03:39.854276 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:39.854241 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1147087_94cd_4db1_b695_512accd102f7.slice/crio-49f5eddfe7e9f8975899ae265cc14f4017c969ef88a6ddc1c941045f42d80b91 WatchSource:0}: Error finding container 49f5eddfe7e9f8975899ae265cc14f4017c969ef88a6ddc1c941045f42d80b91: Status 404 returned error can't find the container with id 49f5eddfe7e9f8975899ae265cc14f4017c969ef88a6ddc1c941045f42d80b91 Jul 09 07:03:39.924083 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:39.924005 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-qxfxl" event={"ID":"d1147087-94cd-4db1-b695-512accd102f7","Type":"ContainerStarted","Data":"49f5eddfe7e9f8975899ae265cc14f4017c969ef88a6ddc1c941045f42d80b91"} Jul 09 07:03:39.926589 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:39.926563 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb5qf" event={"ID":"67b7f45a-88af-4a28-af89-864b69fc0da1","Type":"ContainerStarted","Data":"67c064bd8b27c1d4d14e18a8119778e29a23cfb821b27dcb20eb24678059eb12"} Jul 09 07:03:39.928830 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:39.928609 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4z2f" event={"ID":"e40f8186-5321-4692-8303-24eb101a2fdb","Type":"ContainerStarted","Data":"aba081c99a73d2c4332dec714860a8dac008a0eb87b9120e0b55b65d5c38031e"} Jul 09 07:03:39.931158 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:39.930985 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" event={"ID":"f62e9f63-ef1f-4906-8a5b-19047a9e69b6","Type":"ContainerStarted","Data":"1d290de724cf5070525a40f08a90ad59e4a681346a6b16221b19e666610c3816"} Jul 09 07:03:39.933338 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:39.933299 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" event={"ID":"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9","Type":"ContainerStarted","Data":"074bb78cf02cc8d680e090ed357f1b9c8fc89a7c08a09d6d28e42db6559992be"} Jul 09 07:03:40.945200 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:40.945163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" event={"ID":"f1a26e1c-41a8-42a9-8b7e-e48383dec2b9","Type":"ContainerStarted","Data":"252bd99171e000e7d0310083d8b97989bf158fba8e7ce01854c0b4ddc4f85f6a"} Jul 09 07:03:40.947244 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:40.947218 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4z2f" event={"ID":"e40f8186-5321-4692-8303-24eb101a2fdb","Type":"ContainerStarted","Data":"63a4d0f6157145212926270cfddf30d17411372d8bcecaf7868a23a2a40ba8dc"} Jul 09 07:03:40.947431 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:40.947318 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:40.962986 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:40.962928 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-r6qv7" podStartSLOduration=71.516109709 podStartE2EDuration="1m18.962909508s" totalImagesPullingTime="7.446799799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:40.96249274 +0000 UTC m=+76.966164377" watchObservedRunningTime="2026-07-09 07:03:40.962909508 +0000 UTC m=+76.966581144" Jul 09 07:03:40.980925 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:40.980875 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7g8lj" podStartSLOduration=71.550733025 podStartE2EDuration="1m18.980859378s" totalImagesPullingTime="7.430126353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:40.979406443 +0000 UTC m=+76.983078082" watchObservedRunningTime="2026-07-09 07:03:40.980859378 +0000 UTC m=+76.984531013" Jul 09 07:03:40.998254 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:40.998021 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n4z2f" podStartSLOduration=34.596790993 podStartE2EDuration="41.997999057s" totalImagesPullingTime="7.401208064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:40.996791933 +0000 UTC m=+77.000463571" watchObservedRunningTime="2026-07-09 07:03:40.997999057 +0000 UTC m=+77.001670696" Jul 09 07:03:41.955315 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:41.955273 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb5qf" event={"ID":"67b7f45a-88af-4a28-af89-864b69fc0da1","Type":"ContainerStarted","Data":"0e7552a6752c3f02efc4d7d7de8bb9f50afbe0cf0160c40fc8009ce83b45394e"} Jul 09 07:03:44.970778 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:44.970716 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb5qf" event={"ID":"67b7f45a-88af-4a28-af89-864b69fc0da1","Type":"ContainerStarted","Data":"708d3362a8ac40cf50a70eeccca66042cf942a13c880845c752b3995b3e07f6f"} Jul 09 07:03:44.988678 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:44.988612 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zb5qf" podStartSLOduration=17.195610046 podStartE2EDuration="31.988592022s" totalImagesPullingTime="14.792981976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:03:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:44.987326343 +0000 UTC m=+80.990997980" watchObservedRunningTime="2026-07-09 07:03:44.988592022 +0000 UTC m=+80.992263657" Jul 09 07:03:45.879585 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:45.879551 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bd7cbbc9b-59lj6"] Jul 09 07:03:45.903331 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:45.903302 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd7cbbc9b-59lj6"] Jul 09 07:03:45.903474 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:45.903393 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:45.905767 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:45.905724 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 07:03:45.906010 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:45.905991 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 07:03:45.906095 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:45.906028 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 07:03:45.906245 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:45.906232 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 07:03:45.906771 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:45.906729 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 07:03:45.906872 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:45.906822 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9l2ts\"" Jul 09 07:03:46.001445 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.001382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-oauth-config\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.001907 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.001502 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-serving-cert\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.001907 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.001530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-console-config\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.001907 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.001561 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltlbt\" (UniqueName: \"kubernetes.io/projected/7d38b1f4-764d-46b9-9707-339159525c79-kube-api-access-ltlbt\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.001907 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.001656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-oauth-serving-cert\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.001907 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.001715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-service-ca\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.102219 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.102184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-serving-cert\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.102219 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.102220 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-console-config\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.102452 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.102253 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltlbt\" (UniqueName: \"kubernetes.io/projected/7d38b1f4-764d-46b9-9707-339159525c79-kube-api-access-ltlbt\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.102452 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.102284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-oauth-serving-cert\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.102452 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.102307 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-service-ca\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.102452 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.102368 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-oauth-config\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.103028 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.103004 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-service-ca\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.103178 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.103007 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-console-config\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.103178 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.103074 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-oauth-serving-cert\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.104696 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.104672 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-oauth-config\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.104847 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.104829 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-serving-cert\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.109581 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.109559 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltlbt\" (UniqueName: \"kubernetes.io/projected/7d38b1f4-764d-46b9-9707-339159525c79-kube-api-access-ltlbt\") pod \"console-bd7cbbc9b-59lj6\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.212543 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.212394 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:46.369474 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.369440 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd7cbbc9b-59lj6"] Jul 09 07:03:46.372935 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:46.372908 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d38b1f4_764d_46b9_9707_339159525c79.slice/crio-c58ea9ba3fcb1f781da099fed5f180e4f4edb38e5e7394abe4505353fcce2f5d WatchSource:0}: Error finding container c58ea9ba3fcb1f781da099fed5f180e4f4edb38e5e7394abe4505353fcce2f5d: Status 404 returned error can't find the container with id c58ea9ba3fcb1f781da099fed5f180e4f4edb38e5e7394abe4505353fcce2f5d Jul 09 07:03:46.980956 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:46.980880 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd7cbbc9b-59lj6" event={"ID":"7d38b1f4-764d-46b9-9707-339159525c79","Type":"ContainerStarted","Data":"c58ea9ba3fcb1f781da099fed5f180e4f4edb38e5e7394abe4505353fcce2f5d"} Jul 09 07:03:50.958387 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:50.958353 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n4z2f" Jul 09 07:03:51.003896 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:51.003851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd7cbbc9b-59lj6" event={"ID":"7d38b1f4-764d-46b9-9707-339159525c79","Type":"ContainerStarted","Data":"a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf"} Jul 09 07:03:51.020542 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:51.020491 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bd7cbbc9b-59lj6" podStartSLOduration=2.2636873619999998 podStartE2EDuration="6.020475589s" totalImagesPullingTime="3.756788227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:03:51.01977859 +0000 UTC m=+87.023450225" watchObservedRunningTime="2026-07-09 07:03:51.020475589 +0000 UTC m=+87.024147224" Jul 09 07:03:51.967229 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:51.967184 2565 patch_prober.go:28] interesting pod/image-registry-7446669d59-54vd2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 07:03:51.967702 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:51.967269 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7446669d59-54vd2" podUID="7c6a5609-ef3b-4d4a-8dd0-a03e03217284" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 07:03:52.400796 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.400751 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kcd84"] Jul 09 07:03:52.403652 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.403630 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.406213 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.406190 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8kjsj\"" Jul 09 07:03:52.406303 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.406210 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 07:03:52.406485 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.406465 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 07:03:52.406596 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.406568 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 07:03:52.407020 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.407000 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 07:03:52.450794 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.450750 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.450974 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.450798 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.450974 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.450832 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-textfile\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.450974 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.450848 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c709106-2536-4037-acf4-2a5b51489b22-metrics-client-ca\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.450974 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.450913 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p6gf\" (UniqueName: \"kubernetes.io/projected/7c709106-2536-4037-acf4-2a5b51489b22-kube-api-access-5p6gf\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.450974 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.450953 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-tls\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.451246 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.450995 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c709106-2536-4037-acf4-2a5b51489b22-sys\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.451246 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.451042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c709106-2536-4037-acf4-2a5b51489b22-root\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.451246 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.451076 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-wtmp\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.551545 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.551545 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.551820 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551571 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-textfile\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.551820 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551590 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c709106-2536-4037-acf4-2a5b51489b22-metrics-client-ca\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.551820 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551614 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p6gf\" (UniqueName: \"kubernetes.io/projected/7c709106-2536-4037-acf4-2a5b51489b22-kube-api-access-5p6gf\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.551820 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-tls\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.551820 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c709106-2536-4037-acf4-2a5b51489b22-sys\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.551820 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c709106-2536-4037-acf4-2a5b51489b22-root\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.551820 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551727 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-wtmp\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.551820 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551789 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c709106-2536-4037-acf4-2a5b51489b22-sys\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.552220 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551911 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-wtmp\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.552220 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551960 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c709106-2536-4037-acf4-2a5b51489b22-root\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.552220 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.551975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-textfile\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.552220 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.552183 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.552410 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.552270 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c709106-2536-4037-acf4-2a5b51489b22-metrics-client-ca\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.554031 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.554009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-tls\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.554162 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.554142 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c709106-2536-4037-acf4-2a5b51489b22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.558783 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.558765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p6gf\" (UniqueName: \"kubernetes.io/projected/7c709106-2536-4037-acf4-2a5b51489b22-kube-api-access-5p6gf\") pod \"node-exporter-kcd84\" (UID: \"7c709106-2536-4037-acf4-2a5b51489b22\") " pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.715032 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:52.714942 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcd84" Jul 09 07:03:52.727215 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:03:52.727183 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c709106_2536_4037_acf4_2a5b51489b22.slice/crio-95ded3af2ebdb37a860c34c0468b122518264fa3d88b60de5f59c2f7e34913f1 WatchSource:0}: Error finding container 95ded3af2ebdb37a860c34c0468b122518264fa3d88b60de5f59c2f7e34913f1: Status 404 returned error can't find the container with id 95ded3af2ebdb37a860c34c0468b122518264fa3d88b60de5f59c2f7e34913f1 Jul 09 07:03:53.013945 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.013843 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcd84" event={"ID":"7c709106-2536-4037-acf4-2a5b51489b22","Type":"ContainerStarted","Data":"95ded3af2ebdb37a860c34c0468b122518264fa3d88b60de5f59c2f7e34913f1"} Jul 09 07:03:53.462693 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.462657 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 07:03:53.466304 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.466274 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.468613 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.468576 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 07:03:53.468897 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.468877 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 07:03:53.469066 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.469051 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 07:03:53.469139 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.469068 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 07:03:53.469194 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.469145 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 07:03:53.469194 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.469186 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 07:03:53.469322 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.469055 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 07:03:53.469451 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.469438 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d7zgb\"" Jul 09 07:03:53.469523 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.469454 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 07:03:53.470292 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.470273 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 07:03:53.485953 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.484984 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 07:03:53.561177 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561379 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561196 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561379 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561264 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5649\" (UniqueName: \"kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-kube-api-access-t5649\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561379 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561379 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561611 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561611 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561611 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561455 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561611 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561482 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-web-config\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561611 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561877 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561877 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561673 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-out\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.561877 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.561699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.662627 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.662586 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.662627 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.662630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-out\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.662898 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.662657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.662898 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.662694 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.662898 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.662755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.662898 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.662783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5649\" (UniqueName: \"kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-kube-api-access-t5649\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.662898 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.662815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.662898 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.662837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.663177 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.663061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.663177 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.663115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.663284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.663205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.663284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.663244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-web-config\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.663284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.663273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.664043 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.663774 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.664924 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.664664 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.665100 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.665073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.665823 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.665767 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-out\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.667092 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.666976 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-web-config\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.667254 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.667123 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.667427 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.667404 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.667948 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.667767 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.667948 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.667892 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.667948 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.667933 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.668571 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.668548 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.668979 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.668959 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.670353 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.670335 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5649\" (UniqueName: \"kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-kube-api-access-t5649\") pod \"alertmanager-main-0\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.778549 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.778461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:03:53.888396 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:53.888367 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:03:54.375302 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.375267 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58958d54cb-wtzn4"] Jul 09 07:03:54.378176 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.378149 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.380511 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.380487 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 07:03:54.380680 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.380659 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vn4fq\"" Jul 09 07:03:54.380755 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.380713 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 07:03:54.380755 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.380722 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 07:03:54.380869 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.380713 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4lfth59nocd10\"" Jul 09 07:03:54.380929 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.380910 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 07:03:54.380980 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.380958 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 07:03:54.389924 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.389894 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58958d54cb-wtzn4"] Jul 09 07:03:54.471749 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.471703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.471933 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.471772 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33b66344-658b-48df-aa0f-6b273b44ff71-metrics-client-ca\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.471933 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.471824 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.471933 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.471857 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.471933 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.471881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.472160 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.471940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7phnx\" (UniqueName: \"kubernetes.io/projected/33b66344-658b-48df-aa0f-6b273b44ff71-kube-api-access-7phnx\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.472160 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.472005 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-grpc-tls\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.472160 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.472049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-tls\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.573090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.573050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.573277 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.573109 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33b66344-658b-48df-aa0f-6b273b44ff71-metrics-client-ca\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.573277 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.573186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.573277 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.573236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.573277 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.573270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.573506 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.573297 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7phnx\" (UniqueName: \"kubernetes.io/projected/33b66344-658b-48df-aa0f-6b273b44ff71-kube-api-access-7phnx\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.573506 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.573334 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-grpc-tls\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.573506 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.573375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-tls\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.574047 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.574020 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33b66344-658b-48df-aa0f-6b273b44ff71-metrics-client-ca\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.576431 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.576380 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.576549 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.576473 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.576932 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.576903 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.577150 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.577124 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.577255 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.577159 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-grpc-tls\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.577471 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.577452 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/33b66344-658b-48df-aa0f-6b273b44ff71-secret-thanos-querier-tls\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.581283 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.581264 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7phnx\" (UniqueName: \"kubernetes.io/projected/33b66344-658b-48df-aa0f-6b273b44ff71-kube-api-access-7phnx\") pod \"thanos-querier-58958d54cb-wtzn4\" (UID: \"33b66344-658b-48df-aa0f-6b273b44ff71\") " pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:54.690620 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:54.690536 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:03:56.213399 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:56.213362 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:56.213852 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:56.213431 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:56.218990 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:56.218964 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:57.036866 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:57.036830 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:03:58.277254 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.277214 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7446669d59-54vd2"] Jul 09 07:03:58.604551 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.604510 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 07:03:58.717444 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.717405 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 07:03:58.717618 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.717564 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.720068 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.720043 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 07:03:58.720209 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.720043 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 07:03:58.720513 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.720490 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 07:03:58.720892 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.720868 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 07:03:58.721014 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.720897 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 07:03:58.721014 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.720970 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 07:03:58.721134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.721118 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 07:03:58.721212 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.721202 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 07:03:58.721267 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.721228 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 07:03:58.721679 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.721659 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 07:03:58.722138 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.721985 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 07:03:58.722138 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.722024 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eoq37k9biptnb\"" Jul 09 07:03:58.722138 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.722050 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 07:03:58.723113 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.722542 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 07:03:58.723113 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.722601 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dfbf7\"" Jul 09 07:03:58.724869 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.724847 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 07:03:58.726197 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.726177 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 07:03:58.813942 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.813900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814150 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.813957 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814150 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814018 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814150 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-web-config\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814150 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814220 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9tnl\" (UniqueName: \"kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-kube-api-access-s9tnl\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814519 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814519 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814519 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814519 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814519 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814491 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814519 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814509 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814793 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814536 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config-out\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814793 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814793 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.814793 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.814621 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.915337 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.915236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.915337 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.915294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.915337 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.915326 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.915600 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.915351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.915600 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.915377 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config-out\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.915600 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.915399 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.915923 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.915871 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916055 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.915926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916055 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.915990 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916055 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916021 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916055 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916269 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-web-config\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916269 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916269 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916269 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916203 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916269 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916269 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9tnl\" (UniqueName: \"kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-kube-api-access-s9tnl\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916570 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916570 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916570 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.916781 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.916726 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.917174 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.917148 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.917786 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.917554 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.918609 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.918279 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.918609 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.918542 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.918778 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.918637 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.919391 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.919367 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.920288 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.919966 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.920662 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.920310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.920662 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.920580 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.921239 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.920981 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.921344 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.921260 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.921613 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.921589 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.922182 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.921965 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.922182 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.922096 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.922182 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.922133 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.922378 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.922309 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config-out\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.923109 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.923087 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.923336 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.923306 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-web-config\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:58.926954 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:58.926935 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9tnl\" (UniqueName: \"kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-kube-api-access-s9tnl\") pod \"prometheus-k8s-0\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:03:59.029915 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:03:59.029872 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:04:00.307710 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:00.307682 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 07:04:00.487577 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:04:00.487501 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84d3cc2_399a_4907_89da_5c8e2c88e58e.slice/crio-b5f2876cb315c347a17b6a422d1d7cbdd66642d27eae6323b10c8d1dda274b5f WatchSource:0}: Error finding container b5f2876cb315c347a17b6a422d1d7cbdd66642d27eae6323b10c8d1dda274b5f: Status 404 returned error can't find the container with id b5f2876cb315c347a17b6a422d1d7cbdd66642d27eae6323b10c8d1dda274b5f Jul 09 07:04:00.533853 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:00.533767 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58958d54cb-wtzn4"] Jul 09 07:04:00.537879 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:04:00.537843 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b66344_658b_48df_aa0f_6b273b44ff71.slice/crio-245692e7e5a5b00dc960e789d79b8ee9d02ae7f4588a78444d0b3a7049d026b1 WatchSource:0}: Error finding container 245692e7e5a5b00dc960e789d79b8ee9d02ae7f4588a78444d0b3a7049d026b1: Status 404 returned error can't find the container with id 245692e7e5a5b00dc960e789d79b8ee9d02ae7f4588a78444d0b3a7049d026b1 Jul 09 07:04:00.540215 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:00.540186 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 07:04:00.541819 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:04:00.541789 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af11568_e0cb_45fa_bbb4_eecbd7b908db.slice/crio-196d4bbf4e2d414b4e820fcc5e2267b26c7b9c4616443789b10fdbe83f7ebbea WatchSource:0}: Error finding container 196d4bbf4e2d414b4e820fcc5e2267b26c7b9c4616443789b10fdbe83f7ebbea: Status 404 returned error can't find the container with id 196d4bbf4e2d414b4e820fcc5e2267b26c7b9c4616443789b10fdbe83f7ebbea Jul 09 07:04:01.051165 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:01.051135 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerStarted","Data":"196d4bbf4e2d414b4e820fcc5e2267b26c7b9c4616443789b10fdbe83f7ebbea"} Jul 09 07:04:01.052559 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:01.052529 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" event={"ID":"33b66344-658b-48df-aa0f-6b273b44ff71","Type":"ContainerStarted","Data":"245692e7e5a5b00dc960e789d79b8ee9d02ae7f4588a78444d0b3a7049d026b1"} Jul 09 07:04:01.054349 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:01.054323 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-qxfxl" event={"ID":"d1147087-94cd-4db1-b695-512accd102f7","Type":"ContainerStarted","Data":"3273a8f8bedae882a72b5e678c77232cb8ab3882a5e601b9a1a9e8d5f3b20973"} Jul 09 07:04:01.054541 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:01.054524 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-qxfxl" Jul 09 07:04:01.055808 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:01.055773 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerStarted","Data":"b5f2876cb315c347a17b6a422d1d7cbdd66642d27eae6323b10c8d1dda274b5f"} Jul 09 07:04:01.067878 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:01.067855 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-qxfxl" Jul 09 07:04:01.072506 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:01.072458 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-qxfxl" podStartSLOduration=3.358607015 podStartE2EDuration="24.072441909s" totalImagesPullingTime="20.713834894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:04:01.071208605 +0000 UTC m=+97.074880241" watchObservedRunningTime="2026-07-09 07:04:01.072441909 +0000 UTC m=+97.076113543" Jul 09 07:04:01.859797 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:01.859655 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6qdt7" Jul 09 07:04:02.066203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:02.066155 2565 generic.go:356] "Generic (PLEG): container finished" podID="7c709106-2536-4037-acf4-2a5b51489b22" containerID="be4338c0b1933034317ea1a08a94320816ba5e3476628842b8f584c1dba096e0" exitCode=0 Jul 09 07:04:02.066614 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:02.066363 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcd84" event={"ID":"7c709106-2536-4037-acf4-2a5b51489b22","Type":"ContainerDied","Data":"be4338c0b1933034317ea1a08a94320816ba5e3476628842b8f584c1dba096e0"} Jul 09 07:04:03.075575 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:03.075536 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcd84" event={"ID":"7c709106-2536-4037-acf4-2a5b51489b22","Type":"ContainerStarted","Data":"fb80223d2e88770e50e50b0bfa94799238ed4bc1acd524dd8dafc8634264d08d"} Jul 09 07:04:03.075575 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:03.075592 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcd84" event={"ID":"7c709106-2536-4037-acf4-2a5b51489b22","Type":"ContainerStarted","Data":"c87a516c2feca41dd900ca898a2150659aaa81e974d84abf99903ba14f4753f0"} Jul 09 07:04:03.097884 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:03.097812 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kcd84" podStartSLOduration=2.704631366 podStartE2EDuration="11.097790913s" totalImagesPullingTime="8.293245289s" totalInitContainerRuntime="99.914258ms" isStatefulPod=true podCreationTimestamp="2026-07-09 07:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:04:03.097093789 +0000 UTC m=+99.100765425" watchObservedRunningTime="2026-07-09 07:04:03.097790913 +0000 UTC m=+99.101462550" Jul 09 07:04:04.086065 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:04.086035 2565 generic.go:356] "Generic (PLEG): container finished" podID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerID="b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac" exitCode=0 Jul 09 07:04:04.086474 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:04.086126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerDied","Data":"b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac"} Jul 09 07:04:04.088037 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:04.087959 2565 generic.go:356] "Generic (PLEG): container finished" podID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerID="f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3" exitCode=0 Jul 09 07:04:04.088037 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:04.087988 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerDied","Data":"f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3"} Jul 09 07:04:04.090857 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:04.090438 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" event={"ID":"33b66344-658b-48df-aa0f-6b273b44ff71","Type":"ContainerStarted","Data":"e2debe203e2ef15c0d35a51ee12c2b2d42b705e73563d3acd4ed70cf9278b779"} Jul 09 07:04:05.099970 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:05.099812 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" event={"ID":"33b66344-658b-48df-aa0f-6b273b44ff71","Type":"ContainerStarted","Data":"029f295c36c4444c32959d6704792a71858cef6db168f5469419615f6addffc5"} Jul 09 07:04:05.099970 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:05.099904 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" event={"ID":"33b66344-658b-48df-aa0f-6b273b44ff71","Type":"ContainerStarted","Data":"31ca33b749ebf56cbac270c2395e422c8ff703206d48752fdf352323ccf49c8e"} Jul 09 07:04:08.120761 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:08.120704 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerStarted","Data":"3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764"} Jul 09 07:04:08.121165 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:08.120863 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerStarted","Data":"9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54"} Jul 09 07:04:08.121165 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:08.120913 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerStarted","Data":"b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32"} Jul 09 07:04:08.121165 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:08.120953 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerStarted","Data":"98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780"} Jul 09 07:04:08.121165 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:08.120995 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerStarted","Data":"8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e"} Jul 09 07:04:08.124935 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:08.124905 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" event={"ID":"33b66344-658b-48df-aa0f-6b273b44ff71","Type":"ContainerStarted","Data":"df51c48cea64db5e972a6114d9be1ea812d36f4ac0b85ddf448221dcab905d98"} Jul 09 07:04:08.125127 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:08.125110 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" event={"ID":"33b66344-658b-48df-aa0f-6b273b44ff71","Type":"ContainerStarted","Data":"c4a505628e8f844354d84a407664264e758bf2ddd477eb3a3fb2d755094a13df"} Jul 09 07:04:09.134940 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:09.134897 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerStarted","Data":"ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448"} Jul 09 07:04:09.139071 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:09.139019 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" event={"ID":"33b66344-658b-48df-aa0f-6b273b44ff71","Type":"ContainerStarted","Data":"368b6748f1610c8ff5b6daf940902dd154bbeab496c4c9596fc76f53fde31afd"} Jul 09 07:04:09.139252 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:09.139134 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:04:09.148883 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:09.148851 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" Jul 09 07:04:09.165670 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:09.165614 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.024129122 podStartE2EDuration="16.165592831s" totalImagesPullingTime="6.116088253s" totalInitContainerRuntime="25.375456ms" isStatefulPod=false podCreationTimestamp="2026-07-09 07:03:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:04:09.164336882 +0000 UTC m=+105.168008517" watchObservedRunningTime="2026-07-09 07:04:09.165592831 +0000 UTC m=+105.169264466" Jul 09 07:04:09.186621 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:09.186553 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58958d54cb-wtzn4" podStartSLOduration=8.383793591 podStartE2EDuration="15.186530501s" totalImagesPullingTime="6.80273691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:03:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:04:09.183867456 +0000 UTC m=+105.187539093" watchObservedRunningTime="2026-07-09 07:04:09.186530501 +0000 UTC m=+105.190202138" Jul 09 07:04:11.956148 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:11.956110 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd7cbbc9b-59lj6"] Jul 09 07:04:13.163824 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:13.163786 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerStarted","Data":"967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161"} Jul 09 07:04:13.164264 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:13.163854 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerStarted","Data":"d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e"} Jul 09 07:04:13.164264 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:13.163882 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerStarted","Data":"0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626"} Jul 09 07:04:13.164264 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:13.163910 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerStarted","Data":"e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5"} Jul 09 07:04:13.164264 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:13.163936 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerStarted","Data":"2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e"} Jul 09 07:04:13.164264 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:13.163958 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerStarted","Data":"c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f"} Jul 09 07:04:13.192334 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:13.192285 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.120980838 podStartE2EDuration="15.192267166s" totalImagesPullingTime="11.046132776s" totalInitContainerRuntime="25.153552ms" isStatefulPod=false podCreationTimestamp="2026-07-09 07:03:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:04:13.19043893 +0000 UTC m=+109.194110565" watchObservedRunningTime="2026-07-09 07:04:13.192267166 +0000 UTC m=+109.195938806" Jul 09 07:04:14.030792 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:14.030727 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:04:16.178801 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:16.178693 2565 generic.go:356] "Generic (PLEG): container finished" podID="6966bf5f-cc1f-4c4c-8cdf-5ba57383d978" containerID="990e26e51acbb6051a94c423ae185fb03fccf08f75b6cbc0c3d1e4830cdac2d3" exitCode=0 Jul 09 07:04:16.178801 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:16.178764 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" event={"ID":"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978","Type":"ContainerDied","Data":"990e26e51acbb6051a94c423ae185fb03fccf08f75b6cbc0c3d1e4830cdac2d3"} Jul 09 07:04:16.179194 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:16.179065 2565 scope.go:117] "RemoveContainer" containerID="990e26e51acbb6051a94c423ae185fb03fccf08f75b6cbc0c3d1e4830cdac2d3" Jul 09 07:04:17.185599 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:17.185564 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gwkcl" event={"ID":"6966bf5f-cc1f-4c4c-8cdf-5ba57383d978","Type":"ContainerStarted","Data":"72ed8b9c7ee8b29379f6529039bb9fa84e28f16ce051cbe1ee01c81118447158"} Jul 09 07:04:22.208795 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:22.208764 2565 generic.go:356] "Generic (PLEG): container finished" podID="546495c0-daf9-46dd-b67f-89e0fff7fd2d" containerID="38d6e76059e774987ef97d01626021e7572daf2c91246bb5410fb83cfe560718" exitCode=0 Jul 09 07:04:22.209229 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:22.208802 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" event={"ID":"546495c0-daf9-46dd-b67f-89e0fff7fd2d","Type":"ContainerDied","Data":"38d6e76059e774987ef97d01626021e7572daf2c91246bb5410fb83cfe560718"} Jul 09 07:04:22.209229 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:22.209117 2565 scope.go:117] "RemoveContainer" containerID="38d6e76059e774987ef97d01626021e7572daf2c91246bb5410fb83cfe560718" Jul 09 07:04:23.214265 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.214227 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fwvlw" event={"ID":"546495c0-daf9-46dd-b67f-89e0fff7fd2d","Type":"ContainerStarted","Data":"a9794438e52ce05659625ea87a961b8f06bd8a17551cbdcdb18bf13797f6b2b9"} Jul 09 07:04:23.302815 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.302771 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7446669d59-54vd2" podUID="7c6a5609-ef3b-4d4a-8dd0-a03e03217284" containerName="registry" containerID="cri-o://5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b" gracePeriod=30 Jul 09 07:04:23.592001 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.591974 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:04:23.761667 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.761585 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-certificates\") pod \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " Jul 09 07:04:23.761667 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.761648 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls\") pod \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " Jul 09 07:04:23.761899 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.761686 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6pfh\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-kube-api-access-l6pfh\") pod \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " Jul 09 07:04:23.761899 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.761712 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-image-registry-private-configuration\") pod \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " Jul 09 07:04:23.761899 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.761774 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-bound-sa-token\") pod \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " Jul 09 07:04:23.761899 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.761805 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-trusted-ca\") pod \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " Jul 09 07:04:23.761899 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.761837 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-installation-pull-secrets\") pod \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " Jul 09 07:04:23.761899 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.761868 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-ca-trust-extracted\") pod \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\" (UID: \"7c6a5609-ef3b-4d4a-8dd0-a03e03217284\") " Jul 09 07:04:23.762187 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.762095 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7c6a5609-ef3b-4d4a-8dd0-a03e03217284" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:04:23.762501 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.762454 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7c6a5609-ef3b-4d4a-8dd0-a03e03217284" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:04:23.764437 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.764408 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-kube-api-access-l6pfh" (OuterVolumeSpecName: "kube-api-access-l6pfh") pod "7c6a5609-ef3b-4d4a-8dd0-a03e03217284" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284"). InnerVolumeSpecName "kube-api-access-l6pfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 07:04:23.764559 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.764499 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7c6a5609-ef3b-4d4a-8dd0-a03e03217284" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 07:04:23.764559 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.764515 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7c6a5609-ef3b-4d4a-8dd0-a03e03217284" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:04:23.764647 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.764560 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7c6a5609-ef3b-4d4a-8dd0-a03e03217284" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 07:04:23.764774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.764729 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7c6a5609-ef3b-4d4a-8dd0-a03e03217284" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:04:23.770226 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.770198 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7c6a5609-ef3b-4d4a-8dd0-a03e03217284" (UID: "7c6a5609-ef3b-4d4a-8dd0-a03e03217284"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 07:04:23.863302 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.863263 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-certificates\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:23.863302 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.863296 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-registry-tls\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:23.863302 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.863306 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6pfh\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-kube-api-access-l6pfh\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:23.863538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.863317 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-image-registry-private-configuration\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:23.863538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.863327 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-bound-sa-token\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:23.863538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.863335 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-trusted-ca\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:23.863538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.863343 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-installation-pull-secrets\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:23.863538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:23.863352 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c6a5609-ef3b-4d4a-8dd0-a03e03217284-ca-trust-extracted\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:24.220481 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:24.220443 2565 generic.go:356] "Generic (PLEG): container finished" podID="7c6a5609-ef3b-4d4a-8dd0-a03e03217284" containerID="5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b" exitCode=0 Jul 09 07:04:24.220880 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:24.220494 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7446669d59-54vd2" Jul 09 07:04:24.220880 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:24.220533 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7446669d59-54vd2" event={"ID":"7c6a5609-ef3b-4d4a-8dd0-a03e03217284","Type":"ContainerDied","Data":"5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b"} Jul 09 07:04:24.220880 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:24.220598 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7446669d59-54vd2" event={"ID":"7c6a5609-ef3b-4d4a-8dd0-a03e03217284","Type":"ContainerDied","Data":"56a18e1d52e434ddb291bf93c1ac349e7548951f32b0abbae28580d8fbfa378a"} Jul 09 07:04:24.220880 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:24.220620 2565 scope.go:117] "RemoveContainer" containerID="5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b" Jul 09 07:04:24.229727 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:24.229712 2565 scope.go:117] "RemoveContainer" containerID="5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b" Jul 09 07:04:24.230047 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:04:24.230025 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b\": container with ID starting with 5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b not found: ID does not exist" containerID="5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b" Jul 09 07:04:24.230123 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:24.230055 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b"} err="failed to get container status \"5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b\": rpc error: code = NotFound desc = could not find container \"5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b\": container with ID starting with 5f2978bd5b8655eead4f1ba120f81f1cf6623db92818ee36b7663699840b105b not found: ID does not exist" Jul 09 07:04:24.241430 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:24.241401 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7446669d59-54vd2"] Jul 09 07:04:24.243365 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:24.243343 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7446669d59-54vd2"] Jul 09 07:04:24.526525 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:24.526454 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c6a5609-ef3b-4d4a-8dd0-a03e03217284" path="/var/lib/kubelet/pods/7c6a5609-ef3b-4d4a-8dd0-a03e03217284/volumes" Jul 09 07:04:36.979157 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:36.979088 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bd7cbbc9b-59lj6" podUID="7d38b1f4-764d-46b9-9707-339159525c79" containerName="console" containerID="cri-o://a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf" gracePeriod=15 Jul 09 07:04:37.033359 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.033321 2565 patch_prober.go:28] interesting pod/console-bd7cbbc9b-59lj6 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jul 09 07:04:37.033480 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.033392 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-bd7cbbc9b-59lj6" podUID="7d38b1f4-764d-46b9-9707-339159525c79" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jul 09 07:04:37.257348 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.257277 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:04:37.272645 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.272619 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-oauth-serving-cert\") pod \"7d38b1f4-764d-46b9-9707-339159525c79\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " Jul 09 07:04:37.272803 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.272698 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-serving-cert\") pod \"7d38b1f4-764d-46b9-9707-339159525c79\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " Jul 09 07:04:37.272803 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.272725 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-service-ca\") pod \"7d38b1f4-764d-46b9-9707-339159525c79\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " Jul 09 07:04:37.272803 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.272768 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-oauth-config\") pod \"7d38b1f4-764d-46b9-9707-339159525c79\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " Jul 09 07:04:37.272984 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.272906 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltlbt\" (UniqueName: \"kubernetes.io/projected/7d38b1f4-764d-46b9-9707-339159525c79-kube-api-access-ltlbt\") pod \"7d38b1f4-764d-46b9-9707-339159525c79\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " Jul 09 07:04:37.273037 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.272993 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-console-config\") pod \"7d38b1f4-764d-46b9-9707-339159525c79\" (UID: \"7d38b1f4-764d-46b9-9707-339159525c79\") " Jul 09 07:04:37.273140 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.273095 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d38b1f4-764d-46b9-9707-339159525c79" (UID: "7d38b1f4-764d-46b9-9707-339159525c79"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:04:37.273228 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.273155 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d38b1f4-764d-46b9-9707-339159525c79" (UID: "7d38b1f4-764d-46b9-9707-339159525c79"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:04:37.273379 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.273355 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-service-ca\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:37.273495 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.273383 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-oauth-serving-cert\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:37.273495 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.273395 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-console-config" (OuterVolumeSpecName: "console-config") pod "7d38b1f4-764d-46b9-9707-339159525c79" (UID: "7d38b1f4-764d-46b9-9707-339159525c79"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:04:37.276184 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.276146 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d38b1f4-764d-46b9-9707-339159525c79" (UID: "7d38b1f4-764d-46b9-9707-339159525c79"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:04:37.276288 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.276172 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d38b1f4-764d-46b9-9707-339159525c79" (UID: "7d38b1f4-764d-46b9-9707-339159525c79"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:04:37.276288 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.276190 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d38b1f4-764d-46b9-9707-339159525c79-kube-api-access-ltlbt" (OuterVolumeSpecName: "kube-api-access-ltlbt") pod "7d38b1f4-764d-46b9-9707-339159525c79" (UID: "7d38b1f4-764d-46b9-9707-339159525c79"). InnerVolumeSpecName "kube-api-access-ltlbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 07:04:37.278276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.278248 2565 generic.go:356] "Generic (PLEG): container finished" podID="7d38b1f4-764d-46b9-9707-339159525c79" containerID="a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf" exitCode=0 Jul 09 07:04:37.278692 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.278299 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd7cbbc9b-59lj6" Jul 09 07:04:37.278692 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.278330 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd7cbbc9b-59lj6" event={"ID":"7d38b1f4-764d-46b9-9707-339159525c79","Type":"ContainerDied","Data":"a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf"} Jul 09 07:04:37.278692 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.278411 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd7cbbc9b-59lj6" event={"ID":"7d38b1f4-764d-46b9-9707-339159525c79","Type":"ContainerDied","Data":"c58ea9ba3fcb1f781da099fed5f180e4f4edb38e5e7394abe4505353fcce2f5d"} Jul 09 07:04:37.278692 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.278443 2565 scope.go:117] "RemoveContainer" containerID="a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf" Jul 09 07:04:37.297839 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.297820 2565 scope.go:117] "RemoveContainer" containerID="a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf" Jul 09 07:04:37.298165 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:04:37.298141 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf\": container with ID starting with a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf not found: ID does not exist" containerID="a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf" Jul 09 07:04:37.298255 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.298189 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf"} err="failed to get container status \"a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf\": rpc error: code = NotFound desc = could not find container \"a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf\": container with ID starting with a619078a2c473e37dbf2c15e648bde93024cda208b00a71136eeb9393950f0cf not found: ID does not exist" Jul 09 07:04:37.310030 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.309979 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd7cbbc9b-59lj6"] Jul 09 07:04:37.312140 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.312123 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bd7cbbc9b-59lj6"] Jul 09 07:04:37.373771 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.373748 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d38b1f4-764d-46b9-9707-339159525c79-console-config\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:37.373771 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.373770 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-serving-cert\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:37.373909 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.373780 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d38b1f4-764d-46b9-9707-339159525c79-console-oauth-config\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:37.373909 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:37.373789 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltlbt\" (UniqueName: \"kubernetes.io/projected/7d38b1f4-764d-46b9-9707-339159525c79-kube-api-access-ltlbt\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:04:38.525794 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:38.525765 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d38b1f4-764d-46b9-9707-339159525c79" path="/var/lib/kubelet/pods/7d38b1f4-764d-46b9-9707-339159525c79/volumes" Jul 09 07:04:42.301185 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:42.301154 2565 generic.go:356] "Generic (PLEG): container finished" podID="69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d" containerID="04f64724fd3f73c2cfcd82d166579e2324e7068db9cf14f114976f8251c53e37" exitCode=0 Jul 09 07:04:42.301554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:42.301226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" event={"ID":"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d","Type":"ContainerDied","Data":"04f64724fd3f73c2cfcd82d166579e2324e7068db9cf14f114976f8251c53e37"} Jul 09 07:04:42.301554 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:42.301550 2565 scope.go:117] "RemoveContainer" containerID="04f64724fd3f73c2cfcd82d166579e2324e7068db9cf14f114976f8251c53e37" Jul 09 07:04:43.307956 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:43.307913 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-m5h6q" event={"ID":"69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d","Type":"ContainerStarted","Data":"fbf251f6ecc5cde0e5dc05b512eeabaa8d992321249c356774746a80c06c4a7e"} Jul 09 07:04:59.030573 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:59.030536 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:04:59.046243 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:59.046219 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:04:59.392007 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:04:59.391977 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:12.731346 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:12.731314 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 07:05:12.731843 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:12.731605 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="alertmanager" containerID="cri-o://8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e" gracePeriod=120 Jul 09 07:05:12.731843 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:12.731685 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy-metric" containerID="cri-o://3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764" gracePeriod=120 Jul 09 07:05:12.731975 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:12.731724 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="prom-label-proxy" containerID="cri-o://ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448" gracePeriod=120 Jul 09 07:05:12.732560 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:12.731753 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy-web" containerID="cri-o://b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32" gracePeriod=120 Jul 09 07:05:12.732560 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:12.731787 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy" containerID="cri-o://9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54" gracePeriod=120 Jul 09 07:05:12.732560 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:12.731762 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="config-reloader" containerID="cri-o://98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780" gracePeriod=120 Jul 09 07:05:13.440794 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:13.440756 2565 generic.go:356] "Generic (PLEG): container finished" podID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerID="ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448" exitCode=0 Jul 09 07:05:13.440794 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:13.440786 2565 generic.go:356] "Generic (PLEG): container finished" podID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerID="9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54" exitCode=0 Jul 09 07:05:13.440794 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:13.440799 2565 generic.go:356] "Generic (PLEG): container finished" podID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerID="98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780" exitCode=0 Jul 09 07:05:13.441018 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:13.440808 2565 generic.go:356] "Generic (PLEG): container finished" podID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerID="8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e" exitCode=0 Jul 09 07:05:13.441018 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:13.440777 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerDied","Data":"ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448"} Jul 09 07:05:13.441018 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:13.440920 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerDied","Data":"9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54"} Jul 09 07:05:13.441018 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:13.440951 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerDied","Data":"98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780"} Jul 09 07:05:13.441018 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:13.440976 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerDied","Data":"8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e"} Jul 09 07:05:13.977582 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:13.977558 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.106070 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106045 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5649\" (UniqueName: \"kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-kube-api-access-t5649\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106259 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106081 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-volume\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106259 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106110 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106259 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106134 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106259 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106183 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-trusted-ca-bundle\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106259 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106221 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-metrics-client-ca\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106259 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106246 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-web\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106653 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106284 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-main-tls\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106653 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106604 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:05:14.106788 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106666 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-main-db\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106788 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106698 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-out\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106788 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106695 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:05:14.106788 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106763 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-tls-assets\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106997 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106794 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-web-config\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.106997 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.106837 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-cluster-tls-config\") pod \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\" (UID: \"c84d3cc2-399a-4907-89da-5c8e2c88e58e\") " Jul 09 07:05:14.107377 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.107299 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 07:05:14.108436 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.107839 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-main-db\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.108631 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.108536 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.108631 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.108557 2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c84d3cc2-399a-4907-89da-5c8e2c88e58e-metrics-client-ca\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.109081 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.109045 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:14.109081 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.109076 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-kube-api-access-t5649" (OuterVolumeSpecName: "kube-api-access-t5649") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "kube-api-access-t5649". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 07:05:14.109555 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.109509 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 07:05:14.110107 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.109920 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:14.110107 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.110000 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-out" (OuterVolumeSpecName: "config-out") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 07:05:14.110107 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.110073 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-volume" (OuterVolumeSpecName: "config-volume") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:14.110365 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.110329 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:14.110856 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.110835 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:14.114957 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.114938 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:14.121543 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.121523 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-web-config" (OuterVolumeSpecName: "web-config") pod "c84d3cc2-399a-4907-89da-5c8e2c88e58e" (UID: "c84d3cc2-399a-4907-89da-5c8e2c88e58e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:14.208989 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.208962 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.208989 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.208986 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.209130 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.208997 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.209130 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.209007 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-secret-alertmanager-main-tls\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.209130 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.209017 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-out\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.209130 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.209027 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-tls-assets\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.209130 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.209034 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-web-config\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.209130 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.209042 2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-cluster-tls-config\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.209130 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.209050 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5649\" (UniqueName: \"kubernetes.io/projected/c84d3cc2-399a-4907-89da-5c8e2c88e58e-kube-api-access-t5649\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.209130 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.209058 2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c84d3cc2-399a-4907-89da-5c8e2c88e58e-config-volume\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:14.448007 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.447931 2565 generic.go:356] "Generic (PLEG): container finished" podID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerID="3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764" exitCode=0 Jul 09 07:05:14.448007 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.447955 2565 generic.go:356] "Generic (PLEG): container finished" podID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerID="b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32" exitCode=0 Jul 09 07:05:14.448159 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.448009 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.448159 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.448026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerDied","Data":"3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764"} Jul 09 07:05:14.448159 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.448103 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerDied","Data":"b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32"} Jul 09 07:05:14.448159 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.448140 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c84d3cc2-399a-4907-89da-5c8e2c88e58e","Type":"ContainerDied","Data":"b5f2876cb315c347a17b6a422d1d7cbdd66642d27eae6323b10c8d1dda274b5f"} Jul 09 07:05:14.448281 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.448168 2565 scope.go:117] "RemoveContainer" containerID="ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448" Jul 09 07:05:14.456702 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.456679 2565 scope.go:117] "RemoveContainer" containerID="3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764" Jul 09 07:05:14.463798 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.463775 2565 scope.go:117] "RemoveContainer" containerID="9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54" Jul 09 07:05:14.470442 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.470416 2565 scope.go:117] "RemoveContainer" containerID="b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32" Jul 09 07:05:14.474866 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.474844 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 07:05:14.478511 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.478490 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 07:05:14.478788 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.478772 2565 scope.go:117] "RemoveContainer" containerID="98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780" Jul 09 07:05:14.486255 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.486237 2565 scope.go:117] "RemoveContainer" containerID="8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e" Jul 09 07:05:14.494041 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.494024 2565 scope.go:117] "RemoveContainer" containerID="b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac" Jul 09 07:05:14.501200 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.501179 2565 scope.go:117] "RemoveContainer" containerID="ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448" Jul 09 07:05:14.501486 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:14.501466 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448\": container with ID starting with ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448 not found: ID does not exist" containerID="ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448" Jul 09 07:05:14.501557 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.501492 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448"} err="failed to get container status \"ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448\": rpc error: code = NotFound desc = could not find container \"ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448\": container with ID starting with ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448 not found: ID does not exist" Jul 09 07:05:14.501557 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.501509 2565 scope.go:117] "RemoveContainer" containerID="3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764" Jul 09 07:05:14.501745 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:14.501711 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764\": container with ID starting with 3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764 not found: ID does not exist" containerID="3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764" Jul 09 07:05:14.501796 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.501764 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764"} err="failed to get container status \"3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764\": rpc error: code = NotFound desc = could not find container \"3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764\": container with ID starting with 3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764 not found: ID does not exist" Jul 09 07:05:14.501796 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.501784 2565 scope.go:117] "RemoveContainer" containerID="9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54" Jul 09 07:05:14.502032 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:14.502014 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54\": container with ID starting with 9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54 not found: ID does not exist" containerID="9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54" Jul 09 07:05:14.502096 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.502040 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54"} err="failed to get container status \"9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54\": rpc error: code = NotFound desc = could not find container \"9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54\": container with ID starting with 9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54 not found: ID does not exist" Jul 09 07:05:14.502096 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.502062 2565 scope.go:117] "RemoveContainer" containerID="b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32" Jul 09 07:05:14.502308 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:14.502292 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32\": container with ID starting with b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32 not found: ID does not exist" containerID="b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32" Jul 09 07:05:14.502377 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.502313 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32"} err="failed to get container status \"b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32\": rpc error: code = NotFound desc = could not find container \"b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32\": container with ID starting with b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32 not found: ID does not exist" Jul 09 07:05:14.502377 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.502333 2565 scope.go:117] "RemoveContainer" containerID="98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780" Jul 09 07:05:14.502555 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:14.502536 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780\": container with ID starting with 98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780 not found: ID does not exist" containerID="98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780" Jul 09 07:05:14.502610 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.502563 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780"} err="failed to get container status \"98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780\": rpc error: code = NotFound desc = could not find container \"98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780\": container with ID starting with 98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780 not found: ID does not exist" Jul 09 07:05:14.502610 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.502581 2565 scope.go:117] "RemoveContainer" containerID="8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e" Jul 09 07:05:14.502822 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:14.502807 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e\": container with ID starting with 8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e not found: ID does not exist" containerID="8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e" Jul 09 07:05:14.502863 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.502827 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e"} err="failed to get container status \"8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e\": rpc error: code = NotFound desc = could not find container \"8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e\": container with ID starting with 8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e not found: ID does not exist" Jul 09 07:05:14.502863 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.502842 2565 scope.go:117] "RemoveContainer" containerID="b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac" Jul 09 07:05:14.503062 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:14.503046 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac\": container with ID starting with b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac not found: ID does not exist" containerID="b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac" Jul 09 07:05:14.503125 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.503068 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac"} err="failed to get container status \"b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac\": rpc error: code = NotFound desc = could not find container \"b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac\": container with ID starting with b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac not found: ID does not exist" Jul 09 07:05:14.503125 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.503087 2565 scope.go:117] "RemoveContainer" containerID="ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448" Jul 09 07:05:14.503326 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.503305 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448"} err="failed to get container status \"ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448\": rpc error: code = NotFound desc = could not find container \"ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448\": container with ID starting with ae6f89a5ffda916289112da5727db5dcc78e1a90a79c0d88ca2482a04f19f448 not found: ID does not exist" Jul 09 07:05:14.503375 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.503328 2565 scope.go:117] "RemoveContainer" containerID="3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764" Jul 09 07:05:14.503539 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.503523 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764"} err="failed to get container status \"3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764\": rpc error: code = NotFound desc = could not find container \"3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764\": container with ID starting with 3ff8e70354016360620c72fc279f6ad71c37b187346e1a636402cd6a80709764 not found: ID does not exist" Jul 09 07:05:14.503585 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.503540 2565 scope.go:117] "RemoveContainer" containerID="9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54" Jul 09 07:05:14.503827 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.503809 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54"} err="failed to get container status \"9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54\": rpc error: code = NotFound desc = could not find container \"9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54\": container with ID starting with 9c231a4721c6bb7886df2a0a5f01aa21a3871812af9fac3116a0bf7a0d62dc54 not found: ID does not exist" Jul 09 07:05:14.503881 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.503827 2565 scope.go:117] "RemoveContainer" containerID="b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32" Jul 09 07:05:14.504024 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.504006 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32"} err="failed to get container status \"b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32\": rpc error: code = NotFound desc = could not find container \"b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32\": container with ID starting with b09141410413d4ebcbaf9f38db981952e3b29b386bb842d88dc5b580d9106c32 not found: ID does not exist" Jul 09 07:05:14.504089 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.504026 2565 scope.go:117] "RemoveContainer" containerID="98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780" Jul 09 07:05:14.504243 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.504227 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780"} err="failed to get container status \"98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780\": rpc error: code = NotFound desc = could not find container \"98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780\": container with ID starting with 98fd1b9e8b2e8b802085f3d2bdca6c069839bdfaf5d630e834aa1973377e5780 not found: ID does not exist" Jul 09 07:05:14.504312 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.504244 2565 scope.go:117] "RemoveContainer" containerID="8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e" Jul 09 07:05:14.504452 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.504436 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e"} err="failed to get container status \"8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e\": rpc error: code = NotFound desc = could not find container \"8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e\": container with ID starting with 8a5d230bd2e8f25901154f1d1d56b585171a864392e0e457f3107d0f3ca3b25e not found: ID does not exist" Jul 09 07:05:14.504499 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.504452 2565 scope.go:117] "RemoveContainer" containerID="b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac" Jul 09 07:05:14.504673 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.504652 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac"} err="failed to get container status \"b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac\": rpc error: code = NotFound desc = could not find container \"b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac\": container with ID starting with b34767b68cdcb802df889772a0e2bf0a153022669bf9d753b1518049f078e0ac not found: ID does not exist" Jul 09 07:05:14.513276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513249 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 07:05:14.513594 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513578 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy" Jul 09 07:05:14.513670 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513597 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy" Jul 09 07:05:14.513670 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513619 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d38b1f4-764d-46b9-9707-339159525c79" containerName="console" Jul 09 07:05:14.513670 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513627 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d38b1f4-764d-46b9-9707-339159525c79" containerName="console" Jul 09 07:05:14.513670 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513639 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy-web" Jul 09 07:05:14.513670 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513648 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy-web" Jul 09 07:05:14.513670 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513660 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="config-reloader" Jul 09 07:05:14.513670 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513669 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="config-reloader" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513686 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="alertmanager" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513695 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="alertmanager" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513712 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="init-config-reloader" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513721 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="init-config-reloader" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513776 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="prom-label-proxy" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513786 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="prom-label-proxy" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513797 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c6a5609-ef3b-4d4a-8dd0-a03e03217284" containerName="registry" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513805 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c6a5609-ef3b-4d4a-8dd0-a03e03217284" containerName="registry" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513813 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy-metric" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513823 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy-metric" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513912 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d38b1f4-764d-46b9-9707-339159525c79" containerName="console" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513922 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy-metric" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513930 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c6a5609-ef3b-4d4a-8dd0-a03e03217284" containerName="registry" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513939 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513950 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="alertmanager" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513962 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="prom-label-proxy" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513971 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="kube-rbac-proxy-web" Jul 09 07:05:14.514078 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.513981 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" containerName="config-reloader" Jul 09 07:05:14.518063 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.518045 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.520806 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.520785 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 07:05:14.520902 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.520810 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 07:05:14.520958 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.520921 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d7zgb\"" Jul 09 07:05:14.521604 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.521587 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 07:05:14.521706 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.521687 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 07:05:14.521787 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.521708 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 07:05:14.521787 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.521696 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 07:05:14.522034 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.522017 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 07:05:14.522095 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.522044 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 07:05:14.526340 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.526317 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c84d3cc2-399a-4907-89da-5c8e2c88e58e" path="/var/lib/kubelet/pods/c84d3cc2-399a-4907-89da-5c8e2c88e58e/volumes" Jul 09 07:05:14.528645 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.528629 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 07:05:14.537306 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.537277 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 07:05:14.612046 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612017 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-web-config\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612178 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612178 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzvm2\" (UniqueName: \"kubernetes.io/projected/c9f89738-2269-4dfd-9d04-4118bbdaf72b-kube-api-access-rzvm2\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612178 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612178 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f89738-2269-4dfd-9d04-4118bbdaf72b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612320 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-config-volume\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612320 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9f89738-2269-4dfd-9d04-4118bbdaf72b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612320 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612320 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c9f89738-2269-4dfd-9d04-4118bbdaf72b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612442 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612442 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9f89738-2269-4dfd-9d04-4118bbdaf72b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612442 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612385 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9f89738-2269-4dfd-9d04-4118bbdaf72b-config-out\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.612442 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.612413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713199 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9f89738-2269-4dfd-9d04-4118bbdaf72b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713199 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9f89738-2269-4dfd-9d04-4118bbdaf72b-config-out\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713199 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-web-config\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713225 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713268 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzvm2\" (UniqueName: \"kubernetes.io/projected/c9f89738-2269-4dfd-9d04-4118bbdaf72b-kube-api-access-rzvm2\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713311 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713331 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f89738-2269-4dfd-9d04-4118bbdaf72b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-config-volume\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9f89738-2269-4dfd-9d04-4118bbdaf72b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713767 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713767 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c9f89738-2269-4dfd-9d04-4118bbdaf72b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.713860 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.713803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.714173 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.714014 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9f89738-2269-4dfd-9d04-4118bbdaf72b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.714722 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.714612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c9f89738-2269-4dfd-9d04-4118bbdaf72b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.714909 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.714851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f89738-2269-4dfd-9d04-4118bbdaf72b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.715914 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.715888 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9f89738-2269-4dfd-9d04-4118bbdaf72b-config-out\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.716396 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.716348 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-config-volume\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.716629 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.716600 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.716629 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.716617 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.716796 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.716683 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.716853 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.716814 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-web-config\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.716906 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.716876 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.717426 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.717404 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9f89738-2269-4dfd-9d04-4118bbdaf72b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.718157 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.718141 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9f89738-2269-4dfd-9d04-4118bbdaf72b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.727094 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.727074 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzvm2\" (UniqueName: \"kubernetes.io/projected/c9f89738-2269-4dfd-9d04-4118bbdaf72b-kube-api-access-rzvm2\") pod \"alertmanager-main-0\" (UID: \"c9f89738-2269-4dfd-9d04-4118bbdaf72b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.827275 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.827249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 07:05:14.960640 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:14.960398 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 07:05:14.963268 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:05:14.963216 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f89738_2269_4dfd_9d04_4118bbdaf72b.slice/crio-0ee98b765838b0a33bd264fb2209b3ea40785d086ffc6f7b32a9627d67db934a WatchSource:0}: Error finding container 0ee98b765838b0a33bd264fb2209b3ea40785d086ffc6f7b32a9627d67db934a: Status 404 returned error can't find the container with id 0ee98b765838b0a33bd264fb2209b3ea40785d086ffc6f7b32a9627d67db934a Jul 09 07:05:15.454681 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:15.454643 2565 generic.go:356] "Generic (PLEG): container finished" podID="c9f89738-2269-4dfd-9d04-4118bbdaf72b" containerID="cfc8683f1f611f44fe261a563e6e036f9560bbca75de171ff712ddf3c3dc5748" exitCode=0 Jul 09 07:05:15.455034 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:15.454702 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9f89738-2269-4dfd-9d04-4118bbdaf72b","Type":"ContainerDied","Data":"cfc8683f1f611f44fe261a563e6e036f9560bbca75de171ff712ddf3c3dc5748"} Jul 09 07:05:15.455034 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:15.454766 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9f89738-2269-4dfd-9d04-4118bbdaf72b","Type":"ContainerStarted","Data":"0ee98b765838b0a33bd264fb2209b3ea40785d086ffc6f7b32a9627d67db934a"} Jul 09 07:05:16.462374 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.462296 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9f89738-2269-4dfd-9d04-4118bbdaf72b","Type":"ContainerStarted","Data":"db98b935f480e44ab1719a6607595b4ddd4b8cd04712a5b403b7441995fbe1e9"} Jul 09 07:05:16.462725 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.462378 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9f89738-2269-4dfd-9d04-4118bbdaf72b","Type":"ContainerStarted","Data":"727fab1fc714e6e26a0ada7df45f29a383f9c8754b7540a129a2c5e1747cf9d5"} Jul 09 07:05:16.462725 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.462417 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9f89738-2269-4dfd-9d04-4118bbdaf72b","Type":"ContainerStarted","Data":"98d9c854fdfe60f9c58b3d38d4e438a7f89b414f97655b0ad53f7652e539d7f3"} Jul 09 07:05:16.462725 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.462458 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9f89738-2269-4dfd-9d04-4118bbdaf72b","Type":"ContainerStarted","Data":"ca79ce211f81d9ee74c40d90545ab82bab9be4ae4d7426faa6644ed31c453c0f"} Jul 09 07:05:16.462725 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.462493 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9f89738-2269-4dfd-9d04-4118bbdaf72b","Type":"ContainerStarted","Data":"d4db1b54c24e475d362417bbe0243b4eeac396dfc3e9cc4736e166e05399cadc"} Jul 09 07:05:16.462725 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.462530 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9f89738-2269-4dfd-9d04-4118bbdaf72b","Type":"ContainerStarted","Data":"011002f6cd842497c008890ae538051941d681bba62cf81ab6028eb84d7ae6e1"} Jul 09 07:05:16.491007 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.490962 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.476242764 podStartE2EDuration="2.490946762s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.703998ms" isStatefulPod=false podCreationTimestamp="2026-07-09 07:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:05:16.489978365 +0000 UTC m=+172.493650002" watchObservedRunningTime="2026-07-09 07:05:16.490946762 +0000 UTC m=+172.494618397" Jul 09 07:05:16.840961 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.840927 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-cb5b8765f-jfqnd"] Jul 09 07:05:16.843757 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.843719 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:16.846276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.846248 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 07:05:16.846276 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.846264 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r6wj6\"" Jul 09 07:05:16.846428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.846284 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 07:05:16.846428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.846292 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 07:05:16.846428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.846323 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 07:05:16.846428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.846327 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 07:05:16.852148 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.852128 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 07:05:16.862376 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:16.862356 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-cb5b8765f-jfqnd"] Jul 09 07:05:17.034247 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.034212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-secret-telemeter-client\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.034403 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.034252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fc3679-fb6c-4348-9c20-195279069088-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.034403 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.034280 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87fc3679-fb6c-4348-9c20-195279069088-metrics-client-ca\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.034403 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.034314 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fc3679-fb6c-4348-9c20-195279069088-serving-certs-ca-bundle\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.034403 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.034367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-federate-client-tls\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.034403 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.034381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-telemeter-client-tls\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.034547 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.034407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.034547 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.034425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j42b\" (UniqueName: \"kubernetes.io/projected/87fc3679-fb6c-4348-9c20-195279069088-kube-api-access-9j42b\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.135443 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.135337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fc3679-fb6c-4348-9c20-195279069088-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.135443 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.135409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87fc3679-fb6c-4348-9c20-195279069088-metrics-client-ca\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.135443 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.135442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fc3679-fb6c-4348-9c20-195279069088-serving-certs-ca-bundle\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.135755 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.135656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-federate-client-tls\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.135755 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.135687 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-telemeter-client-tls\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.135867 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.135755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.135867 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.135784 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j42b\" (UniqueName: \"kubernetes.io/projected/87fc3679-fb6c-4348-9c20-195279069088-kube-api-access-9j42b\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.135867 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.135827 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-secret-telemeter-client\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.136320 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.136294 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fc3679-fb6c-4348-9c20-195279069088-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.136412 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.136300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fc3679-fb6c-4348-9c20-195279069088-serving-certs-ca-bundle\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.136770 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.136722 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87fc3679-fb6c-4348-9c20-195279069088-metrics-client-ca\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.138410 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.138388 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-federate-client-tls\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.138574 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.138553 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.138663 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.138646 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-secret-telemeter-client\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.138699 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.138666 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/87fc3679-fb6c-4348-9c20-195279069088-telemeter-client-tls\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.150041 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.150022 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j42b\" (UniqueName: \"kubernetes.io/projected/87fc3679-fb6c-4348-9c20-195279069088-kube-api-access-9j42b\") pod \"telemeter-client-cb5b8765f-jfqnd\" (UID: \"87fc3679-fb6c-4348-9c20-195279069088\") " pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.155873 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.155848 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" Jul 09 07:05:17.181966 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.181936 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 07:05:17.182509 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.182349 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="prometheus" containerID="cri-o://c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f" gracePeriod=600 Jul 09 07:05:17.182509 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.182366 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy" containerID="cri-o://d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e" gracePeriod=600 Jul 09 07:05:17.182509 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.182388 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="thanos-sidecar" containerID="cri-o://e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5" gracePeriod=600 Jul 09 07:05:17.182509 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.182388 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="config-reloader" containerID="cri-o://2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e" gracePeriod=600 Jul 09 07:05:17.182509 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.182404 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy-web" containerID="cri-o://0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626" gracePeriod=600 Jul 09 07:05:17.182509 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.182376 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy-thanos" containerID="cri-o://967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161" gracePeriod=600 Jul 09 07:05:17.339825 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.339794 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-cb5b8765f-jfqnd"] Jul 09 07:05:17.342907 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:05:17.342879 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87fc3679_fb6c_4348_9c20_195279069088.slice/crio-309650f75a43dff5a4e4720e4bee2be2ca67c0934a0753058c36b35a2f4530da WatchSource:0}: Error finding container 309650f75a43dff5a4e4720e4bee2be2ca67c0934a0753058c36b35a2f4530da: Status 404 returned error can't find the container with id 309650f75a43dff5a4e4720e4bee2be2ca67c0934a0753058c36b35a2f4530da Jul 09 07:05:17.470174 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.470147 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" event={"ID":"87fc3679-fb6c-4348-9c20-195279069088","Type":"ContainerStarted","Data":"309650f75a43dff5a4e4720e4bee2be2ca67c0934a0753058c36b35a2f4530da"} Jul 09 07:05:17.473368 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.473344 2565 generic.go:356] "Generic (PLEG): container finished" podID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerID="967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161" exitCode=0 Jul 09 07:05:17.473368 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.473367 2565 generic.go:356] "Generic (PLEG): container finished" podID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerID="e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5" exitCode=0 Jul 09 07:05:17.473480 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.473374 2565 generic.go:356] "Generic (PLEG): container finished" podID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerID="2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e" exitCode=0 Jul 09 07:05:17.473480 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.473381 2565 generic.go:356] "Generic (PLEG): container finished" podID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerID="c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f" exitCode=0 Jul 09 07:05:17.473480 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.473415 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerDied","Data":"967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161"} Jul 09 07:05:17.473576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.473481 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerDied","Data":"e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5"} Jul 09 07:05:17.473576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.473526 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerDied","Data":"2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e"} Jul 09 07:05:17.473576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:17.473564 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerDied","Data":"c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f"} Jul 09 07:05:18.425374 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.425349 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.483513 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.483475 2565 generic.go:356] "Generic (PLEG): container finished" podID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerID="d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e" exitCode=0 Jul 09 07:05:18.483513 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.483508 2565 generic.go:356] "Generic (PLEG): container finished" podID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerID="0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626" exitCode=0 Jul 09 07:05:18.484025 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.483574 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.484025 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.483569 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerDied","Data":"d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e"} Jul 09 07:05:18.484025 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.483771 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerDied","Data":"0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626"} Jul 09 07:05:18.484025 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.483828 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5af11568-e0cb-45fa-bbb4-eecbd7b908db","Type":"ContainerDied","Data":"196d4bbf4e2d414b4e820fcc5e2267b26c7b9c4616443789b10fdbe83f7ebbea"} Jul 09 07:05:18.484025 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.483828 2565 scope.go:117] "RemoveContainer" containerID="967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161" Jul 09 07:05:18.493208 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.493186 2565 scope.go:117] "RemoveContainer" containerID="d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e" Jul 09 07:05:18.502315 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.502272 2565 scope.go:117] "RemoveContainer" containerID="0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626" Jul 09 07:05:18.510305 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.510284 2565 scope.go:117] "RemoveContainer" containerID="e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5" Jul 09 07:05:18.518895 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.518863 2565 scope.go:117] "RemoveContainer" containerID="2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e" Jul 09 07:05:18.527491 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.527469 2565 scope.go:117] "RemoveContainer" containerID="c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f" Jul 09 07:05:18.535581 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.535557 2565 scope.go:117] "RemoveContainer" containerID="f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3" Jul 09 07:05:18.542206 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.542177 2565 scope.go:117] "RemoveContainer" containerID="967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161" Jul 09 07:05:18.542455 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:18.542431 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161\": container with ID starting with 967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161 not found: ID does not exist" containerID="967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161" Jul 09 07:05:18.542510 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.542468 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161"} err="failed to get container status \"967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161\": rpc error: code = NotFound desc = could not find container \"967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161\": container with ID starting with 967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161 not found: ID does not exist" Jul 09 07:05:18.542510 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.542489 2565 scope.go:117] "RemoveContainer" containerID="d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e" Jul 09 07:05:18.542711 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:18.542695 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e\": container with ID starting with d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e not found: ID does not exist" containerID="d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e" Jul 09 07:05:18.542780 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.542714 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e"} err="failed to get container status \"d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e\": rpc error: code = NotFound desc = could not find container \"d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e\": container with ID starting with d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e not found: ID does not exist" Jul 09 07:05:18.542780 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.542726 2565 scope.go:117] "RemoveContainer" containerID="0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626" Jul 09 07:05:18.542958 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:18.542941 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626\": container with ID starting with 0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626 not found: ID does not exist" containerID="0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626" Jul 09 07:05:18.542998 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.542962 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626"} err="failed to get container status \"0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626\": rpc error: code = NotFound desc = could not find container \"0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626\": container with ID starting with 0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626 not found: ID does not exist" Jul 09 07:05:18.542998 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.542976 2565 scope.go:117] "RemoveContainer" containerID="e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5" Jul 09 07:05:18.543201 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:18.543184 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5\": container with ID starting with e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5 not found: ID does not exist" containerID="e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5" Jul 09 07:05:18.543243 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.543204 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5"} err="failed to get container status \"e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5\": rpc error: code = NotFound desc = could not find container \"e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5\": container with ID starting with e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5 not found: ID does not exist" Jul 09 07:05:18.543243 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.543216 2565 scope.go:117] "RemoveContainer" containerID="2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e" Jul 09 07:05:18.543448 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:18.543427 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e\": container with ID starting with 2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e not found: ID does not exist" containerID="2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e" Jul 09 07:05:18.543511 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.543456 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e"} err="failed to get container status \"2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e\": rpc error: code = NotFound desc = could not find container \"2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e\": container with ID starting with 2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e not found: ID does not exist" Jul 09 07:05:18.543511 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.543478 2565 scope.go:117] "RemoveContainer" containerID="c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f" Jul 09 07:05:18.543716 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:18.543699 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f\": container with ID starting with c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f not found: ID does not exist" containerID="c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f" Jul 09 07:05:18.543841 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.543724 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f"} err="failed to get container status \"c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f\": rpc error: code = NotFound desc = could not find container \"c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f\": container with ID starting with c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f not found: ID does not exist" Jul 09 07:05:18.543943 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.543844 2565 scope.go:117] "RemoveContainer" containerID="f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3" Jul 09 07:05:18.544117 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:05:18.544098 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3\": container with ID starting with f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3 not found: ID does not exist" containerID="f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3" Jul 09 07:05:18.544180 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.544121 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3"} err="failed to get container status \"f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3\": rpc error: code = NotFound desc = could not find container \"f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3\": container with ID starting with f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3 not found: ID does not exist" Jul 09 07:05:18.544180 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.544135 2565 scope.go:117] "RemoveContainer" containerID="967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161" Jul 09 07:05:18.544353 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.544337 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161"} err="failed to get container status \"967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161\": rpc error: code = NotFound desc = could not find container \"967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161\": container with ID starting with 967632c82f61ade2f66bbcf6f67a889fcfab2b59b2ef9eb9070a677139055161 not found: ID does not exist" Jul 09 07:05:18.544411 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.544356 2565 scope.go:117] "RemoveContainer" containerID="d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e" Jul 09 07:05:18.544570 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.544553 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e"} err="failed to get container status \"d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e\": rpc error: code = NotFound desc = could not find container \"d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e\": container with ID starting with d9efb08715fc8161044021dcd62782ab332b3ce7bcbdad3fcc3f67ead290da6e not found: ID does not exist" Jul 09 07:05:18.544570 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.544569 2565 scope.go:117] "RemoveContainer" containerID="0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626" Jul 09 07:05:18.544783 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.544767 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626"} err="failed to get container status \"0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626\": rpc error: code = NotFound desc = could not find container \"0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626\": container with ID starting with 0d315c904ffc9634ad548ce23f24d31fc8b5cdba28de80a2b35ee2891420c626 not found: ID does not exist" Jul 09 07:05:18.544783 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.544783 2565 scope.go:117] "RemoveContainer" containerID="e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5" Jul 09 07:05:18.544977 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.544962 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5"} err="failed to get container status \"e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5\": rpc error: code = NotFound desc = could not find container \"e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5\": container with ID starting with e9c3a1cd91cf9fce95cfbb89714b9103417b020c83108b60590914a270bd10b5 not found: ID does not exist" Jul 09 07:05:18.545028 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.544977 2565 scope.go:117] "RemoveContainer" containerID="2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e" Jul 09 07:05:18.545196 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.545176 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e"} err="failed to get container status \"2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e\": rpc error: code = NotFound desc = could not find container \"2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e\": container with ID starting with 2c9bac4f7c4fb035e39ab818499bbd26fc066f8d33e2c3d69b44eb68fe1cf34e not found: ID does not exist" Jul 09 07:05:18.545196 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.545195 2565 scope.go:117] "RemoveContainer" containerID="c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f" Jul 09 07:05:18.545373 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.545356 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f"} err="failed to get container status \"c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f\": rpc error: code = NotFound desc = could not find container \"c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f\": container with ID starting with c3ed883e3a0683eed0778186ba40111c403b420a32d716e9e1d683fd3da5984f not found: ID does not exist" Jul 09 07:05:18.545421 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.545374 2565 scope.go:117] "RemoveContainer" containerID="f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3" Jul 09 07:05:18.545610 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.545593 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3"} err="failed to get container status \"f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3\": rpc error: code = NotFound desc = could not find container \"f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3\": container with ID starting with f0b2365e1994871f2b7a30558030b35968c4335be6de174c924ab750eab42bf3 not found: ID does not exist" Jul 09 07:05:18.550888 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.550868 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-thanos-prometheus-http-client-file\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.550961 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.550900 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-serving-certs-ca-bundle\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.550961 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.550932 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551064 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.550966 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-web-config\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551064 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.550982 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551064 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551008 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-metrics-client-certs\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551064 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551024 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-2\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551064 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551057 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-kubelet-serving-ca-bundle\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551303 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551088 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551303 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551133 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-1\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551303 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551163 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-0\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551303 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551197 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-trusted-ca-bundle\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551303 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551227 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9tnl\" (UniqueName: \"kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-kube-api-access-s9tnl\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551303 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551253 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-tls\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551303 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551280 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config-out\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551646 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551316 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-tls-assets\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551646 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551340 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-kube-rbac-proxy\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551646 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551370 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:05:18.551646 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551385 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-metrics-client-ca\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551646 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551420 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-db\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551646 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551457 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-grpc-tls\") pod \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\" (UID: \"5af11568-e0cb-45fa-bbb4-eecbd7b908db\") " Jul 09 07:05:18.551982 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551712 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:05:18.551982 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.551725 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.552708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.552116 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:05:18.552708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.552376 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:05:18.552708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.552681 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:05:18.553150 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.553124 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:05:18.553895 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.553866 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:18.553992 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.553941 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:18.554230 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.554206 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 07:05:18.554702 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.554661 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 07:05:18.554874 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.554818 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:18.554874 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.554831 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:18.555163 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.555130 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:18.555279 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.555256 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:18.555471 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.555447 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config" (OuterVolumeSpecName: "config") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:18.555752 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.555715 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:18.556476 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.556451 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config-out" (OuterVolumeSpecName: "config-out") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 07:05:18.556580 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.556556 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-kube-api-access-s9tnl" (OuterVolumeSpecName: "kube-api-access-s9tnl") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "kube-api-access-s9tnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 07:05:18.556671 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.556655 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 07:05:18.566169 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.566146 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-web-config" (OuterVolumeSpecName: "web-config") pod "5af11568-e0cb-45fa-bbb4-eecbd7b908db" (UID: "5af11568-e0cb-45fa-bbb4-eecbd7b908db"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:05:18.652637 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652600 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652637 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652636 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652637 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652645 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652655 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652664 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9tnl\" (UniqueName: \"kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-kube-api-access-s9tnl\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652673 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652681 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-config-out\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652690 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5af11568-e0cb-45fa-bbb4-eecbd7b908db-tls-assets\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652698 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-kube-rbac-proxy\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652706 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-metrics-client-ca\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652714 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5af11568-e0cb-45fa-bbb4-eecbd7b908db-prometheus-k8s-db\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652723 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-grpc-tls\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652752 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652764 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652773 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652783 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-web-config\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652793 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652801 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5af11568-e0cb-45fa-bbb4-eecbd7b908db-secret-metrics-client-certs\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.652834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.652811 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af11568-e0cb-45fa-bbb4-eecbd7b908db-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:05:18.810489 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.810454 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 07:05:18.815136 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.815113 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 07:05:18.850197 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850154 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 07:05:18.850492 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850480 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="prometheus" Jul 09 07:05:18.850538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850494 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="prometheus" Jul 09 07:05:18.850538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850510 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="thanos-sidecar" Jul 09 07:05:18.850538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850515 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="thanos-sidecar" Jul 09 07:05:18.850538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850523 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy" Jul 09 07:05:18.850538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850529 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy" Jul 09 07:05:18.850538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850537 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy-thanos" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850542 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy-thanos" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850551 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="init-config-reloader" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850557 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="init-config-reloader" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850567 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="config-reloader" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850572 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="config-reloader" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850578 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy-web" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850584 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy-web" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850638 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="config-reloader" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850645 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="thanos-sidecar" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850652 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850660 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="prometheus" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850667 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy-web" Jul 09 07:05:18.850774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.850673 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" containerName="kube-rbac-proxy-thanos" Jul 09 07:05:18.854729 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.854708 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.857247 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.857224 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 07:05:18.857247 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.857238 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 07:05:18.857459 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.857288 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 07:05:18.857459 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.857403 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 07:05:18.857580 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.857548 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 07:05:18.857710 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.857688 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 07:05:18.857846 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.857725 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eoq37k9biptnb\"" Jul 09 07:05:18.858085 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.858064 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 07:05:18.858183 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.858103 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 07:05:18.858332 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.858313 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 07:05:18.858332 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.858331 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 07:05:18.858525 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.858429 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 07:05:18.858627 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.858555 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 07:05:18.858903 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.858886 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dfbf7\"" Jul 09 07:05:18.858992 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.858903 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 07:05:18.861785 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.861766 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 07:05:18.864532 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.864513 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 07:05:18.878577 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.878555 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 07:05:18.955958 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.955921 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956132 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.955963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956132 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956132 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956132 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956050 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3b71775-306c-4203-9f71-0a82f2f3bc71-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956132 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956105 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956194 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3b71775-306c-4203-9f71-0a82f2f3bc71-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956433 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956343 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-config\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956433 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956374 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956433 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956535 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956535 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956535 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956502 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956535 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6svl6\" (UniqueName: \"kubernetes.io/projected/f3b71775-306c-4203-9f71-0a82f2f3bc71-kube-api-access-6svl6\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956700 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956700 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956603 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956700 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:18.956700 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:18.956674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.057962 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.057917 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.057962 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.057969 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.058507 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.058481 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.058712 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.058797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.058976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6svl6\" (UniqueName: \"kubernetes.io/projected/f3b71775-306c-4203-9f71-0a82f2f3bc71-kube-api-access-6svl6\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.059025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.059153 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.059197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.059417 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.059482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.059619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.059791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.059935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.060072 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3b71775-306c-4203-9f71-0a82f2f3bc71-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.060127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.060168 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.060373 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.060426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3b71775-306c-4203-9f71-0a82f2f3bc71-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.065363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.060557 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.060759 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-config\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.060705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.061695 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.061897 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.062524 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.062597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.063117 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.064271 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.065560 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.065753 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.066296 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.066890 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.066669 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.067290 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.067198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.067434 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.067414 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b71775-306c-4203-9f71-0a82f2f3bc71-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.068373 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.068094 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.068494 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.068428 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3b71775-306c-4203-9f71-0a82f2f3bc71-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.069617 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.069593 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.069750 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.069711 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3b71775-306c-4203-9f71-0a82f2f3bc71-config\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.070458 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.070437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3b71775-306c-4203-9f71-0a82f2f3bc71-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.071434 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.071416 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6svl6\" (UniqueName: \"kubernetes.io/projected/f3b71775-306c-4203-9f71-0a82f2f3bc71-kube-api-access-6svl6\") pod \"prometheus-k8s-0\" (UID: \"f3b71775-306c-4203-9f71-0a82f2f3bc71\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.167248 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.167218 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:05:19.307097 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.307071 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 07:05:19.309033 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:05:19.308977 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b71775_306c_4203_9f71_0a82f2f3bc71.slice/crio-3df008386104e213c2d40e32acb996bf7fa91ae417d2ef7d8a54fd90c03c667a WatchSource:0}: Error finding container 3df008386104e213c2d40e32acb996bf7fa91ae417d2ef7d8a54fd90c03c667a: Status 404 returned error can't find the container with id 3df008386104e213c2d40e32acb996bf7fa91ae417d2ef7d8a54fd90c03c667a Jul 09 07:05:19.490544 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.490501 2565 generic.go:356] "Generic (PLEG): container finished" podID="f3b71775-306c-4203-9f71-0a82f2f3bc71" containerID="72cea07482aa51c572106a3b22f6e182b40f69345c93f2acc770f7bb8d78925c" exitCode=0 Jul 09 07:05:19.490983 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.490583 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3b71775-306c-4203-9f71-0a82f2f3bc71","Type":"ContainerDied","Data":"72cea07482aa51c572106a3b22f6e182b40f69345c93f2acc770f7bb8d78925c"} Jul 09 07:05:19.490983 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:19.490651 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3b71775-306c-4203-9f71-0a82f2f3bc71","Type":"ContainerStarted","Data":"3df008386104e213c2d40e32acb996bf7fa91ae417d2ef7d8a54fd90c03c667a"} Jul 09 07:05:20.501341 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.501256 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3b71775-306c-4203-9f71-0a82f2f3bc71","Type":"ContainerStarted","Data":"e1128b15274d6e2febcf25abb6fef876ae32278768352e00053126f1077b1ebc"} Jul 09 07:05:20.501341 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.501328 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3b71775-306c-4203-9f71-0a82f2f3bc71","Type":"ContainerStarted","Data":"f0e730e8f6b85faf2f2b3bb98124f14efc0130b9148686d41add3df1a5497dcb"} Jul 09 07:05:20.501844 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.501370 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3b71775-306c-4203-9f71-0a82f2f3bc71","Type":"ContainerStarted","Data":"7886e494c188cdaddd29e866076ae350c6c4d4c58113961dd7d00428bce5846e"} Jul 09 07:05:20.501844 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.501408 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3b71775-306c-4203-9f71-0a82f2f3bc71","Type":"ContainerStarted","Data":"859f27d05e194be6e0abed324cf4e7168fe8c92cae0f745a45efd6370968dbd0"} Jul 09 07:05:20.501844 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.501439 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3b71775-306c-4203-9f71-0a82f2f3bc71","Type":"ContainerStarted","Data":"8c4c3cd05733c1310022561301a1404a9574f1542cc99f68c5e0991c0e6e9f54"} Jul 09 07:05:20.501844 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.501478 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3b71775-306c-4203-9f71-0a82f2f3bc71","Type":"ContainerStarted","Data":"868bed334d9a03d92170d62c313bbf63e89b3db2ff7f2038bde2e35bf16a750f"} Jul 09 07:05:20.503329 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.503303 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" event={"ID":"87fc3679-fb6c-4348-9c20-195279069088","Type":"ContainerStarted","Data":"c09c7204abcb2217a8b822d1b64bf8f5eb06aebc615d9a2f2eacda43d32b1945"} Jul 09 07:05:20.503604 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.503352 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" event={"ID":"87fc3679-fb6c-4348-9c20-195279069088","Type":"ContainerStarted","Data":"16cded85fc6aae5b46746cbab396b17b95c5b6152be641b34bfd5a3cbe769259"} Jul 09 07:05:20.503604 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.503371 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" event={"ID":"87fc3679-fb6c-4348-9c20-195279069088","Type":"ContainerStarted","Data":"4375c9cd157519154c79fef3030437dc4d93934b43bf1716e3e122cc620e3151"} Jul 09 07:05:20.526421 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.526394 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5af11568-e0cb-45fa-bbb4-eecbd7b908db" path="/var/lib/kubelet/pods/5af11568-e0cb-45fa-bbb4-eecbd7b908db/volumes" Jul 09 07:05:20.533098 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.533046 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.510748824 podStartE2EDuration="2.53303139s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.282566ms" isStatefulPod=false podCreationTimestamp="2026-07-09 07:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:05:20.530680734 +0000 UTC m=+176.534352368" watchObservedRunningTime="2026-07-09 07:05:20.53303139 +0000 UTC m=+176.536703026" Jul 09 07:05:20.552294 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:20.552253 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-cb5b8765f-jfqnd" podStartSLOduration=1.783429066 podStartE2EDuration="4.552238842s" totalImagesPullingTime="2.768809776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:05:20.550499544 +0000 UTC m=+176.554171180" watchObservedRunningTime="2026-07-09 07:05:20.552238842 +0000 UTC m=+176.555910476" Jul 09 07:05:24.167851 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:05:24.167820 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:06:19.167557 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:06:19.167524 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:06:19.183232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:06:19.183207 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:06:19.759746 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:06:19.759700 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 07:07:24.379520 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:07:24.379493 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:07:24.381450 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:07:24.381426 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:07:24.391903 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:07:24.391879 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 07:09:03.807959 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.807916 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv"] Jul 09 07:09:03.811513 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.811491 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:03.813970 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.813946 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 07:09:03.814047 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.813976 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 07:09:03.814674 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.814656 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 07:09:03.814778 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.814711 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 07:09:03.814778 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.814716 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 07:09:03.814778 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.814726 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8z8ht\"" Jul 09 07:09:03.821414 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.821394 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv"] Jul 09 07:09:03.965799 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.965773 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/662bd347-b1f6-424b-845f-cb4f09b74c8b-metrics-cert\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:03.965941 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.965815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662bd347-b1f6-424b-845f-cb4f09b74c8b-cert\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:03.965941 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.965908 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/662bd347-b1f6-424b-845f-cb4f09b74c8b-manager-config\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:03.966038 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:03.965968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzn85\" (UniqueName: \"kubernetes.io/projected/662bd347-b1f6-424b-845f-cb4f09b74c8b-kube-api-access-zzn85\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:04.066793 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.066686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/662bd347-b1f6-424b-845f-cb4f09b74c8b-metrics-cert\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:04.066793 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.066726 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662bd347-b1f6-424b-845f-cb4f09b74c8b-cert\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:04.067019 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.066802 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/662bd347-b1f6-424b-845f-cb4f09b74c8b-manager-config\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:04.067019 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.066846 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzn85\" (UniqueName: \"kubernetes.io/projected/662bd347-b1f6-424b-845f-cb4f09b74c8b-kube-api-access-zzn85\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:04.067512 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.067490 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/662bd347-b1f6-424b-845f-cb4f09b74c8b-manager-config\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:04.069251 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.069228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/662bd347-b1f6-424b-845f-cb4f09b74c8b-metrics-cert\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:04.069333 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.069231 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662bd347-b1f6-424b-845f-cb4f09b74c8b-cert\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:04.075484 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.075458 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzn85\" (UniqueName: \"kubernetes.io/projected/662bd347-b1f6-424b-845f-cb4f09b74c8b-kube-api-access-zzn85\") pod \"lws-controller-manager-7bbcbb4454-nfgvv\" (UID: \"662bd347-b1f6-424b-845f-cb4f09b74c8b\") " pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:04.121487 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.121460 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:04.249232 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.249199 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv"] Jul 09 07:09:04.252648 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:09:04.252622 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662bd347_b1f6_424b_845f_cb4f09b74c8b.slice/crio-1bd5280a49415524756a45cbac5036142baa31fbbed5d019e3c1996f9b7285ff WatchSource:0}: Error finding container 1bd5280a49415524756a45cbac5036142baa31fbbed5d019e3c1996f9b7285ff: Status 404 returned error can't find the container with id 1bd5280a49415524756a45cbac5036142baa31fbbed5d019e3c1996f9b7285ff Jul 09 07:09:04.254938 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.254917 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 07:09:04.417326 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:04.417244 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" event={"ID":"662bd347-b1f6-424b-845f-cb4f09b74c8b","Type":"ContainerStarted","Data":"1bd5280a49415524756a45cbac5036142baa31fbbed5d019e3c1996f9b7285ff"} Jul 09 07:09:16.423980 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.423951 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd"] Jul 09 07:09:16.427255 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.427239 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.430924 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.430902 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 07:09:16.431478 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.431457 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 07:09:16.431598 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.431580 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l47m2\"" Jul 09 07:09:16.431648 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.431599 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 07:09:16.431687 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.431581 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 07:09:16.446778 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.446757 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd"] Jul 09 07:09:16.464460 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.464429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc99e37d-8a39-49d6-94a5-e3c00bae5626-tmp\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.464622 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.464481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsr6q\" (UniqueName: \"kubernetes.io/projected/dc99e37d-8a39-49d6-94a5-e3c00bae5626-kube-api-access-rsr6q\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.464622 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.464513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc99e37d-8a39-49d6-94a5-e3c00bae5626-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.464622 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.464591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc99e37d-8a39-49d6-94a5-e3c00bae5626-manifests\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.464780 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.464621 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc99e37d-8a39-49d6-94a5-e3c00bae5626-webhook-cert\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.469354 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.469328 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" event={"ID":"662bd347-b1f6-424b-845f-cb4f09b74c8b","Type":"ContainerStarted","Data":"65245e68e4af65921405f88e0e3116cd9cc71cb5d425183c7a79b4dda78cb6d6"} Jul 09 07:09:16.469471 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.469392 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:16.496773 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.496704 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" podStartSLOduration=1.8729059000000001 podStartE2EDuration="13.496691583s" totalImagesPullingTime="11.623785683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:09:16.496628478 +0000 UTC m=+412.500300113" watchObservedRunningTime="2026-07-09 07:09:16.496691583 +0000 UTC m=+412.500363207" Jul 09 07:09:16.565090 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.565064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc99e37d-8a39-49d6-94a5-e3c00bae5626-manifests\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.565190 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.565111 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc99e37d-8a39-49d6-94a5-e3c00bae5626-webhook-cert\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.565190 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.565174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc99e37d-8a39-49d6-94a5-e3c00bae5626-tmp\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.565294 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.565256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsr6q\" (UniqueName: \"kubernetes.io/projected/dc99e37d-8a39-49d6-94a5-e3c00bae5626-kube-api-access-rsr6q\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.565503 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.565477 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc99e37d-8a39-49d6-94a5-e3c00bae5626-manifests\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.565588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.565545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc99e37d-8a39-49d6-94a5-e3c00bae5626-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.567631 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.567602 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc99e37d-8a39-49d6-94a5-e3c00bae5626-tmp\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.567772 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.567752 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc99e37d-8a39-49d6-94a5-e3c00bae5626-webhook-cert\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.567838 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.567816 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc99e37d-8a39-49d6-94a5-e3c00bae5626-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.573123 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.573101 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsr6q\" (UniqueName: \"kubernetes.io/projected/dc99e37d-8a39-49d6-94a5-e3c00bae5626-kube-api-access-rsr6q\") pod \"opendatahub-operator-controller-manager-b96c58b47-nr5sd\" (UID: \"dc99e37d-8a39-49d6-94a5-e3c00bae5626\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.737694 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.737611 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:16.878373 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:16.878342 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd"] Jul 09 07:09:16.880794 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:09:16.880762 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc99e37d_8a39_49d6_94a5_e3c00bae5626.slice/crio-b845f7bb1a72c7131ad78e7f1c66cc3765abe59c26fe8e81e3a390ac9e226794 WatchSource:0}: Error finding container b845f7bb1a72c7131ad78e7f1c66cc3765abe59c26fe8e81e3a390ac9e226794: Status 404 returned error can't find the container with id b845f7bb1a72c7131ad78e7f1c66cc3765abe59c26fe8e81e3a390ac9e226794 Jul 09 07:09:17.475211 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:17.475171 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" event={"ID":"dc99e37d-8a39-49d6-94a5-e3c00bae5626","Type":"ContainerStarted","Data":"b845f7bb1a72c7131ad78e7f1c66cc3765abe59c26fe8e81e3a390ac9e226794"} Jul 09 07:09:20.490923 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:20.490884 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" event={"ID":"dc99e37d-8a39-49d6-94a5-e3c00bae5626","Type":"ContainerStarted","Data":"66b24ee8f75853c65856bc8a06fa6570e8b4e94b90f432a6b4388e5865bbbcf6"} Jul 09 07:09:21.496418 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:21.496386 2565 generic.go:356] "Generic (PLEG): container finished" podID="dc99e37d-8a39-49d6-94a5-e3c00bae5626" containerID="66b24ee8f75853c65856bc8a06fa6570e8b4e94b90f432a6b4388e5865bbbcf6" exitCode=0 Jul 09 07:09:21.496839 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:21.496438 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" event={"ID":"dc99e37d-8a39-49d6-94a5-e3c00bae5626","Type":"ContainerDied","Data":"66b24ee8f75853c65856bc8a06fa6570e8b4e94b90f432a6b4388e5865bbbcf6"} Jul 09 07:09:22.502123 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:22.502084 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" event={"ID":"dc99e37d-8a39-49d6-94a5-e3c00bae5626","Type":"ContainerStarted","Data":"68da168a38852ba6e2045afbcdd6b7ebfe97a74c14b14b73888b96f3af7c5bd8"} Jul 09 07:09:22.502502 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:22.502186 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:22.523932 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:22.523879 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" podStartSLOduration=2.044882416 podStartE2EDuration="6.523864191s" totalImagesPullingTime="3.396521577s" totalInitContainerRuntime="1.082460198s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:09:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:09:22.521586954 +0000 UTC m=+418.525258589" watchObservedRunningTime="2026-07-09 07:09:22.523864191 +0000 UTC m=+418.527535856" Jul 09 07:09:27.477990 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:27.477954 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bbcbb4454-nfgvv" Jul 09 07:09:33.509379 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:33.509351 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b96c58b47-nr5sd" Jul 09 07:09:46.594507 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.594427 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s"] Jul 09 07:09:46.606052 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.606028 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:46.608476 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.608452 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 07:09:46.608609 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.608560 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-89tpg\"" Jul 09 07:09:46.608669 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.608566 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 07:09:46.612293 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.612232 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s"] Jul 09 07:09:46.730583 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.730540 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a93b1d30-adcd-4a00-b429-34c73c07c770-tls-certs\") pod \"kube-auth-proxy-7f58fd5d48-xmr6s\" (UID: \"a93b1d30-adcd-4a00-b429-34c73c07c770\") " pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:46.730798 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.730597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ggsd\" (UniqueName: \"kubernetes.io/projected/a93b1d30-adcd-4a00-b429-34c73c07c770-kube-api-access-9ggsd\") pod \"kube-auth-proxy-7f58fd5d48-xmr6s\" (UID: \"a93b1d30-adcd-4a00-b429-34c73c07c770\") " pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:46.730798 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.730695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a93b1d30-adcd-4a00-b429-34c73c07c770-tmp\") pod \"kube-auth-proxy-7f58fd5d48-xmr6s\" (UID: \"a93b1d30-adcd-4a00-b429-34c73c07c770\") " pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:46.832146 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.832112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a93b1d30-adcd-4a00-b429-34c73c07c770-tmp\") pod \"kube-auth-proxy-7f58fd5d48-xmr6s\" (UID: \"a93b1d30-adcd-4a00-b429-34c73c07c770\") " pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:46.832327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.832183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a93b1d30-adcd-4a00-b429-34c73c07c770-tls-certs\") pod \"kube-auth-proxy-7f58fd5d48-xmr6s\" (UID: \"a93b1d30-adcd-4a00-b429-34c73c07c770\") " pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:46.832327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.832210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ggsd\" (UniqueName: \"kubernetes.io/projected/a93b1d30-adcd-4a00-b429-34c73c07c770-kube-api-access-9ggsd\") pod \"kube-auth-proxy-7f58fd5d48-xmr6s\" (UID: \"a93b1d30-adcd-4a00-b429-34c73c07c770\") " pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:46.832327 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:09:46.832290 2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 09 07:09:46.832492 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:09:46.832365 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93b1d30-adcd-4a00-b429-34c73c07c770-tls-certs podName:a93b1d30-adcd-4a00-b429-34c73c07c770 nodeName:}" failed. No retries permitted until 2026-07-09 07:09:47.332342485 +0000 UTC m=+443.336014107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a93b1d30-adcd-4a00-b429-34c73c07c770-tls-certs") pod "kube-auth-proxy-7f58fd5d48-xmr6s" (UID: "a93b1d30-adcd-4a00-b429-34c73c07c770") : secret "kube-auth-proxy-tls" not found Jul 09 07:09:46.834401 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.834379 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a93b1d30-adcd-4a00-b429-34c73c07c770-tmp\") pod \"kube-auth-proxy-7f58fd5d48-xmr6s\" (UID: \"a93b1d30-adcd-4a00-b429-34c73c07c770\") " pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:46.852626 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:46.852576 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ggsd\" (UniqueName: \"kubernetes.io/projected/a93b1d30-adcd-4a00-b429-34c73c07c770-kube-api-access-9ggsd\") pod \"kube-auth-proxy-7f58fd5d48-xmr6s\" (UID: \"a93b1d30-adcd-4a00-b429-34c73c07c770\") " pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:47.336596 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:47.336565 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a93b1d30-adcd-4a00-b429-34c73c07c770-tls-certs\") pod \"kube-auth-proxy-7f58fd5d48-xmr6s\" (UID: \"a93b1d30-adcd-4a00-b429-34c73c07c770\") " pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:47.339007 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:47.338982 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a93b1d30-adcd-4a00-b429-34c73c07c770-tls-certs\") pod \"kube-auth-proxy-7f58fd5d48-xmr6s\" (UID: \"a93b1d30-adcd-4a00-b429-34c73c07c770\") " pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:47.516672 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:47.516634 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" Jul 09 07:09:47.645437 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:47.645409 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s"] Jul 09 07:09:47.648148 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:09:47.648122 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93b1d30_adcd_4a00_b429_34c73c07c770.slice/crio-09c7679e0d2dbe60dea38687ebec6530ebf568d772e853062c411e38b4d03f2b WatchSource:0}: Error finding container 09c7679e0d2dbe60dea38687ebec6530ebf568d772e853062c411e38b4d03f2b: Status 404 returned error can't find the container with id 09c7679e0d2dbe60dea38687ebec6530ebf568d772e853062c411e38b4d03f2b Jul 09 07:09:48.624646 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:48.624604 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" event={"ID":"a93b1d30-adcd-4a00-b429-34c73c07c770","Type":"ContainerStarted","Data":"09c7679e0d2dbe60dea38687ebec6530ebf568d772e853062c411e38b4d03f2b"} Jul 09 07:09:50.636758 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:50.636692 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" event={"ID":"a93b1d30-adcd-4a00-b429-34c73c07c770","Type":"ContainerStarted","Data":"2fb7dea083dcd219811e24cd3109ffa02fb68249b81931a8def7ee8b38da23c1"} Jul 09 07:09:50.653358 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:09:50.653235 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f58fd5d48-xmr6s" podStartSLOduration=1.901870175 podStartE2EDuration="4.653219828s" totalImagesPullingTime="2.751349653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:09:50.651804071 +0000 UTC m=+446.655475706" watchObservedRunningTime="2026-07-09 07:09:50.653219828 +0000 UTC m=+446.656891462" Jul 09 07:11:30.149885 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.149804 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92"] Jul 09 07:11:30.153259 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.153237 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:30.156920 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.156897 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 09 07:11:30.157022 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.156928 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 09 07:11:30.157204 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.157188 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 07:11:30.157242 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.157227 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 07:11:30.157848 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.157831 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9hnnf\"" Jul 09 07:11:30.162701 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.162675 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92"] Jul 09 07:11:30.317246 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.317215 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ngn92\" (UID: \"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:30.317246 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.317245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc2h2\" (UniqueName: \"kubernetes.io/projected/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-kube-api-access-zc2h2\") pod \"kuadrant-console-plugin-66b5774985-ngn92\" (UID: \"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:30.317428 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.317269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ngn92\" (UID: \"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:30.418579 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.418485 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ngn92\" (UID: \"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:30.418579 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.418522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc2h2\" (UniqueName: \"kubernetes.io/projected/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-kube-api-access-zc2h2\") pod \"kuadrant-console-plugin-66b5774985-ngn92\" (UID: \"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:30.418579 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.418551 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ngn92\" (UID: \"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:30.418874 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:11:30.418699 2565 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 09 07:11:30.418874 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:11:30.418806 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-plugin-serving-cert podName:e8a65fe3-66d6-4f55-b9f0-83398a80d8a6 nodeName:}" failed. No retries permitted until 2026-07-09 07:11:30.918787385 +0000 UTC m=+546.922458997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-ngn92" (UID: "e8a65fe3-66d6-4f55-b9f0-83398a80d8a6") : secret "plugin-serving-cert" not found Jul 09 07:11:30.419187 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.419168 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ngn92\" (UID: \"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:30.429599 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.429574 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc2h2\" (UniqueName: \"kubernetes.io/projected/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-kube-api-access-zc2h2\") pod \"kuadrant-console-plugin-66b5774985-ngn92\" (UID: \"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:30.923834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.923800 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ngn92\" (UID: \"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:30.926178 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:30.926158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a65fe3-66d6-4f55-b9f0-83398a80d8a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ngn92\" (UID: \"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:31.068367 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:31.068336 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" Jul 09 07:11:31.220842 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:31.220760 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92"] Jul 09 07:11:31.226912 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:11:31.226879 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8a65fe3_66d6_4f55_b9f0_83398a80d8a6.slice/crio-5eb4df80cb9dd34dcb3efd47001b997fc2aa24d8ad211c07d9a67f02bc0d2bbb WatchSource:0}: Error finding container 5eb4df80cb9dd34dcb3efd47001b997fc2aa24d8ad211c07d9a67f02bc0d2bbb: Status 404 returned error can't find the container with id 5eb4df80cb9dd34dcb3efd47001b997fc2aa24d8ad211c07d9a67f02bc0d2bbb Jul 09 07:11:32.102002 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:32.101943 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" event={"ID":"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6","Type":"ContainerStarted","Data":"5eb4df80cb9dd34dcb3efd47001b997fc2aa24d8ad211c07d9a67f02bc0d2bbb"} Jul 09 07:11:57.234684 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:57.234648 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" event={"ID":"e8a65fe3-66d6-4f55-b9f0-83398a80d8a6","Type":"ContainerStarted","Data":"63dcab9cef2ef0a95a63a8e7200925152f207393d363b560db9ec6a27e56f0e1"} Jul 09 07:11:57.253203 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:11:57.253156 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ngn92" podStartSLOduration=2.062859247 podStartE2EDuration="27.253140399s" totalImagesPullingTime="25.190281152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:11:57.251207111 +0000 UTC m=+573.254878743" watchObservedRunningTime="2026-07-09 07:11:57.253140399 +0000 UTC m=+573.256812033" Jul 09 07:12:20.214646 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.214614 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:12:20.217165 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.217150 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" Jul 09 07:12:20.219528 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.219507 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 07:12:20.227871 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.227848 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:12:20.247050 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.247023 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:12:20.283050 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.283025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5r4v\" (UniqueName: \"kubernetes.io/projected/c2be787d-1014-4806-8456-98bd99e68b19-kube-api-access-f5r4v\") pod \"limitador-limitador-54d6d988d5-zqjm5\" (UID: \"c2be787d-1014-4806-8456-98bd99e68b19\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" Jul 09 07:12:20.283180 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.283161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2be787d-1014-4806-8456-98bd99e68b19-config-file\") pod \"limitador-limitador-54d6d988d5-zqjm5\" (UID: \"c2be787d-1014-4806-8456-98bd99e68b19\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" Jul 09 07:12:20.384559 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.384526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2be787d-1014-4806-8456-98bd99e68b19-config-file\") pod \"limitador-limitador-54d6d988d5-zqjm5\" (UID: \"c2be787d-1014-4806-8456-98bd99e68b19\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" Jul 09 07:12:20.384703 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.384562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5r4v\" (UniqueName: \"kubernetes.io/projected/c2be787d-1014-4806-8456-98bd99e68b19-kube-api-access-f5r4v\") pod \"limitador-limitador-54d6d988d5-zqjm5\" (UID: \"c2be787d-1014-4806-8456-98bd99e68b19\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" Jul 09 07:12:20.385136 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.385117 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2be787d-1014-4806-8456-98bd99e68b19-config-file\") pod \"limitador-limitador-54d6d988d5-zqjm5\" (UID: \"c2be787d-1014-4806-8456-98bd99e68b19\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" Jul 09 07:12:20.394140 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.394111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5r4v\" (UniqueName: \"kubernetes.io/projected/c2be787d-1014-4806-8456-98bd99e68b19-kube-api-access-f5r4v\") pod \"limitador-limitador-54d6d988d5-zqjm5\" (UID: \"c2be787d-1014-4806-8456-98bd99e68b19\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" Jul 09 07:12:20.527182 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.527112 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" Jul 09 07:12:20.681594 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:20.681568 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:12:20.683918 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:12:20.683886 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2be787d_1014_4806_8456_98bd99e68b19.slice/crio-26db5f5938fa53a15e05f94a1ca48f6e51db449d059ad087f64ae289fc98e5ca WatchSource:0}: Error finding container 26db5f5938fa53a15e05f94a1ca48f6e51db449d059ad087f64ae289fc98e5ca: Status 404 returned error can't find the container with id 26db5f5938fa53a15e05f94a1ca48f6e51db449d059ad087f64ae289fc98e5ca Jul 09 07:12:21.345716 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:21.345627 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" event={"ID":"c2be787d-1014-4806-8456-98bd99e68b19","Type":"ContainerStarted","Data":"26db5f5938fa53a15e05f94a1ca48f6e51db449d059ad087f64ae289fc98e5ca"} Jul 09 07:12:24.362888 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:24.362858 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" event={"ID":"c2be787d-1014-4806-8456-98bd99e68b19","Type":"ContainerStarted","Data":"33816d06bd24bed7f6132366e7f046deb96aa8aaa28e8b293735e29be82f698c"} Jul 09 07:12:24.363281 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:24.362956 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" Jul 09 07:12:24.387553 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:24.387506 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" podStartSLOduration=1.59029431 podStartE2EDuration="4.387490196s" totalImagesPullingTime="2.797195886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:12:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:12:24.386670851 +0000 UTC m=+600.390342484" watchObservedRunningTime="2026-07-09 07:12:24.387490196 +0000 UTC m=+600.391161872" Jul 09 07:12:24.413179 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:24.413156 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:12:24.413310 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:24.413156 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:12:35.368502 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:12:35.368472 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zqjm5" Jul 09 07:13:36.788401 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:13:36.788366 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:14:14.089607 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:14.089563 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:14:35.077532 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:35.077450 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:14:47.897048 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.897016 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx"] Jul 09 07:14:47.900613 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.900594 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:47.903926 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.903905 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 07:14:47.905300 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.905280 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rch4x\"" Jul 09 07:14:47.905406 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.905298 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 07:14:47.905406 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.905365 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 07:14:47.910793 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.910771 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx"] Jul 09 07:14:47.962416 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.962384 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:47.962533 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.962421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:47.962533 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.962445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:47.962533 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.962492 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc9317a-81da-42ed-8992-bba2be1c1cf0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:47.962533 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.962524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86kx9\" (UniqueName: \"kubernetes.io/projected/6dc9317a-81da-42ed-8992-bba2be1c1cf0-kube-api-access-86kx9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:47.962665 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:47.962585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.063959 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.063919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.063959 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.063956 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.064212 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.063976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.064212 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.064098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc9317a-81da-42ed-8992-bba2be1c1cf0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.064212 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.064148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86kx9\" (UniqueName: \"kubernetes.io/projected/6dc9317a-81da-42ed-8992-bba2be1c1cf0-kube-api-access-86kx9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.064212 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.064177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.064432 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.064336 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.064432 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.064417 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.064534 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.064463 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.066196 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.066170 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc9317a-81da-42ed-8992-bba2be1c1cf0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.066484 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.066461 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc9317a-81da-42ed-8992-bba2be1c1cf0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.077489 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.077457 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86kx9\" (UniqueName: \"kubernetes.io/projected/6dc9317a-81da-42ed-8992-bba2be1c1cf0-kube-api-access-86kx9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz8lx\" (UID: \"6dc9317a-81da-42ed-8992-bba2be1c1cf0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.211511 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.211421 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:48.345002 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.344976 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx"] Jul 09 07:14:48.347595 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:14:48.347572 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc9317a_81da_42ed_8992_bba2be1c1cf0.slice/crio-731d45c3471599c4a10cc7505ae44f7563dbf6620304cd1ddeb79347f6ef44cb WatchSource:0}: Error finding container 731d45c3471599c4a10cc7505ae44f7563dbf6620304cd1ddeb79347f6ef44cb: Status 404 returned error can't find the container with id 731d45c3471599c4a10cc7505ae44f7563dbf6620304cd1ddeb79347f6ef44cb Jul 09 07:14:48.348953 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.348935 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 07:14:48.982612 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:48.982578 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:14:49.030380 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:49.030342 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" event={"ID":"6dc9317a-81da-42ed-8992-bba2be1c1cf0","Type":"ContainerStarted","Data":"731d45c3471599c4a10cc7505ae44f7563dbf6620304cd1ddeb79347f6ef44cb"} Jul 09 07:14:50.036838 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:50.036800 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" event={"ID":"6dc9317a-81da-42ed-8992-bba2be1c1cf0","Type":"ContainerStarted","Data":"8a7d42e8ae1b16207f2572fc91549552fee6dbecf527e9ba1ee6070aa2998369"} Jul 09 07:14:50.058409 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:50.058359 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" podStartSLOduration=1.971190499 podStartE2EDuration="3.058343007s" totalImagesPullingTime="1.087152508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:14:50.058024855 +0000 UTC m=+746.061696491" watchObservedRunningTime="2026-07-09 07:14:50.058343007 +0000 UTC m=+746.062014641" Jul 09 07:14:58.211559 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:58.211525 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:58.211971 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:58.211578 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:58.224281 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:58.224254 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:14:59.091350 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:14:59.091323 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz8lx" Jul 09 07:15:05.683552 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.683514 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4"] Jul 09 07:15:05.687725 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.687703 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.690255 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.690233 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 09 07:15:05.696525 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.696503 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4"] Jul 09 07:15:05.825248 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.825204 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.825248 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.825253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.825467 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.825273 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.825467 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.825433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p8x4\" (UniqueName: \"kubernetes.io/projected/a21e405e-984d-44dd-a85e-8d5509a59376-kube-api-access-9p8x4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.825539 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.825466 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a21e405e-984d-44dd-a85e-8d5509a59376-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.825539 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.825492 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.926021 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.925988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.926181 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.926027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.926181 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.926043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.926181 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.926120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p8x4\" (UniqueName: \"kubernetes.io/projected/a21e405e-984d-44dd-a85e-8d5509a59376-kube-api-access-9p8x4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.926181 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.926140 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a21e405e-984d-44dd-a85e-8d5509a59376-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.926181 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.926160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.926450 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.926419 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.926579 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.926559 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.926642 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.926574 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.928339 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.928320 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a21e405e-984d-44dd-a85e-8d5509a59376-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.928712 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.928691 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a21e405e-984d-44dd-a85e-8d5509a59376-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.934297 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.934245 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p8x4\" (UniqueName: \"kubernetes.io/projected/a21e405e-984d-44dd-a85e-8d5509a59376-kube-api-access-9p8x4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4\" (UID: \"a21e405e-984d-44dd-a85e-8d5509a59376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:05.999719 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:05.999683 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:06.131508 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:06.131484 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4"] Jul 09 07:15:06.133490 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:15:06.133460 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21e405e_984d_44dd_a85e_8d5509a59376.slice/crio-72b910a67fb37bdb368815bed25b20f7596f0b455f1adb1ec76c7951f53c1c1e WatchSource:0}: Error finding container 72b910a67fb37bdb368815bed25b20f7596f0b455f1adb1ec76c7951f53c1c1e: Status 404 returned error can't find the container with id 72b910a67fb37bdb368815bed25b20f7596f0b455f1adb1ec76c7951f53c1c1e Jul 09 07:15:07.120489 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:07.120447 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" event={"ID":"a21e405e-984d-44dd-a85e-8d5509a59376","Type":"ContainerStarted","Data":"e784b06b6ce939b0f69bc6dddea2c3865958259bc748098dfc6408379f346e1e"} Jul 09 07:15:07.121003 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:07.120503 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" event={"ID":"a21e405e-984d-44dd-a85e-8d5509a59376","Type":"ContainerStarted","Data":"72b910a67fb37bdb368815bed25b20f7596f0b455f1adb1ec76c7951f53c1c1e"} Jul 09 07:15:07.140966 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:07.140917 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" podStartSLOduration=1.944596984 podStartE2EDuration="2.140901915s" totalImagesPullingTime="196.304931ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:15:07.13853267 +0000 UTC m=+763.142204331" watchObservedRunningTime="2026-07-09 07:15:07.140901915 +0000 UTC m=+763.144573549" Jul 09 07:15:07.285385 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:07.285349 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:15:11.388250 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.388214 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb"] Jul 09 07:15:11.394871 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.394845 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.397571 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.397548 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 07:15:11.398522 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.398478 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb"] Jul 09 07:15:11.474010 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.473983 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5e6059e-c796-41b6-8517-ccf6890919e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.474171 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.474024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.474171 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.474046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.474171 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.474145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsl6v\" (UniqueName: \"kubernetes.io/projected/a5e6059e-c796-41b6-8517-ccf6890919e5-kube-api-access-lsl6v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.474282 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.474192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.474282 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.474219 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.576966 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.576075 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.576966 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.576142 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.576966 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.576201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsl6v\" (UniqueName: \"kubernetes.io/projected/a5e6059e-c796-41b6-8517-ccf6890919e5-kube-api-access-lsl6v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.576966 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.576244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.576966 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.576288 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.576966 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.576388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5e6059e-c796-41b6-8517-ccf6890919e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.579961 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.579937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.580481 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.580463 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.581347 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.581328 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.582774 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.582727 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5e6059e-c796-41b6-8517-ccf6890919e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.583983 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.583962 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5e6059e-c796-41b6-8517-ccf6890919e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.589291 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.589270 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsl6v\" (UniqueName: \"kubernetes.io/projected/a5e6059e-c796-41b6-8517-ccf6890919e5-kube-api-access-lsl6v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ldmrb\" (UID: \"a5e6059e-c796-41b6-8517-ccf6890919e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.706605 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.706530 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:11.843265 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:11.843220 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb"] Jul 09 07:15:11.844811 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:15:11.844783 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e6059e_c796_41b6_8517_ccf6890919e5.slice/crio-a6e2518d069bd8506eb502bb6974b5b3798e2d52088f50ea546d2645f2ada95a WatchSource:0}: Error finding container a6e2518d069bd8506eb502bb6974b5b3798e2d52088f50ea546d2645f2ada95a: Status 404 returned error can't find the container with id a6e2518d069bd8506eb502bb6974b5b3798e2d52088f50ea546d2645f2ada95a Jul 09 07:15:12.145634 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:12.145605 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" event={"ID":"a5e6059e-c796-41b6-8517-ccf6890919e5","Type":"ContainerStarted","Data":"ec30e25b9085ffb0f69331c74517ae597336731b13ae5d7e2f81127ae67d2b19"} Jul 09 07:15:12.145722 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:12.145667 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" event={"ID":"a5e6059e-c796-41b6-8517-ccf6890919e5","Type":"ContainerStarted","Data":"a6e2518d069bd8506eb502bb6974b5b3798e2d52088f50ea546d2645f2ada95a"} Jul 09 07:15:12.163801 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:12.163750 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" podStartSLOduration=0.928181713 podStartE2EDuration="1.163718491s" totalImagesPullingTime="235.536778ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:15:12.161820718 +0000 UTC m=+768.165492353" watchObservedRunningTime="2026-07-09 07:15:12.163718491 +0000 UTC m=+768.167390126" Jul 09 07:15:14.591894 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:14.591861 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:15:16.000435 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:16.000404 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:16.000821 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:16.000459 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:16.013147 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:16.013118 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:16.175273 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:16.175245 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4" Jul 09 07:15:17.373134 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.373100 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc"] Jul 09 07:15:17.377599 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.377555 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.379989 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.379971 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 09 07:15:17.387949 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.387920 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc"] Jul 09 07:15:17.530032 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.530000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.530221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.530050 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.530221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.530076 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.530221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.530171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.530221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.530209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvpbp\" (UniqueName: \"kubernetes.io/projected/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-kube-api-access-pvpbp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.530349 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.530227 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.630857 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.630778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.630857 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.630817 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.631038 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.630858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.631038 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.630904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvpbp\" (UniqueName: \"kubernetes.io/projected/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-kube-api-access-pvpbp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.631139 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.631023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.631139 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.631108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.631139 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.631129 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.631303 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.631284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.631432 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.631409 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.633004 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.632985 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.633362 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.633343 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.639260 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.639236 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvpbp\" (UniqueName: \"kubernetes.io/projected/022931de-d7ae-4fe8-aff6-a3c9f60bce4c-kube-api-access-pvpbp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc\" (UID: \"022931de-d7ae-4fe8-aff6-a3c9f60bce4c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.689941 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.689908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:17.822409 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:17.822385 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc"] Jul 09 07:15:17.824634 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:15:17.824602 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod022931de_d7ae_4fe8_aff6_a3c9f60bce4c.slice/crio-128c90ebc218f07be7f05325fe8f1930c3903c65f4a33ef95e4ffd1ccb04a77a WatchSource:0}: Error finding container 128c90ebc218f07be7f05325fe8f1930c3903c65f4a33ef95e4ffd1ccb04a77a: Status 404 returned error can't find the container with id 128c90ebc218f07be7f05325fe8f1930c3903c65f4a33ef95e4ffd1ccb04a77a Jul 09 07:15:18.174807 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:18.174768 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" event={"ID":"022931de-d7ae-4fe8-aff6-a3c9f60bce4c","Type":"ContainerStarted","Data":"a9ab9ef07e173de97571bd56c99eac35d9c3af0756f29fca05cf130645c767bf"} Jul 09 07:15:18.174939 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:18.174818 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" event={"ID":"022931de-d7ae-4fe8-aff6-a3c9f60bce4c","Type":"ContainerStarted","Data":"128c90ebc218f07be7f05325fe8f1930c3903c65f4a33ef95e4ffd1ccb04a77a"} Jul 09 07:15:18.193528 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:18.193473 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" podStartSLOduration=0.99275574 podStartE2EDuration="1.193457432s" totalImagesPullingTime="200.701692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:15:18.191557455 +0000 UTC m=+774.195229089" watchObservedRunningTime="2026-07-09 07:15:18.193457432 +0000 UTC m=+774.197129090" Jul 09 07:15:20.990629 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:20.990592 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:15:21.707007 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:21.706978 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:21.707181 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:21.707029 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:21.718988 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:21.718966 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:22.205410 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:22.205384 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ldmrb" Jul 09 07:15:27.690884 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:27.690846 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:27.690884 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:27.690889 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:27.703146 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:27.703117 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:15:28.235724 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:15:28.235691 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc" Jul 09 07:16:25.497406 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:16:25.497368 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:16:35.412160 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:16:35.412123 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:16:46.830031 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:16:46.829996 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:16:56.804708 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:16:56.804673 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:17:06.309366 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:17:06.309332 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:17:24.443435 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:17:24.443406 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:17:24.444340 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:17:24.444315 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:17:35.446382 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:17:35.446350 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:17:46.657051 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:17:46.657013 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:18:23.497650 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:18:23.497617 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:18:31.296233 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:18:31.296194 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:18:42.291956 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:18:42.291926 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:18:50.497016 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:18:50.496938 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:19:01.099089 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:19:01.099053 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:19:10.195835 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:19:10.195800 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:19:22.006248 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:19:22.006215 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:19:31.896544 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:19:31.896503 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:19:38.697027 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:19:38.696987 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:19:45.894464 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:19:45.894423 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:19:57.490946 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:19:57.490909 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:20:05.396588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:20:05.396552 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:20:30.893989 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:20:30.893951 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:20:42.396052 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:20:42.396018 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:20:57.596190 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:20:57.596157 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:21:06.691704 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:21:06.691670 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:21:16.290913 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:21:16.290877 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:21:25.794371 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:21:25.794338 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:21:34.511284 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:21:34.511250 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:22:24.475334 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:22:24.475307 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:22:24.477416 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:22:24.477393 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:23:24.424573 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:23:24.424539 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:23:33.492043 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:23:33.492011 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:23:46.613102 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:23:46.613070 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:23:57.208987 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:23:57.208951 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:24:09.300968 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:24:09.300929 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:24:18.992345 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:24:18.992311 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:24:27.011815 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:24:27.011775 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:24:38.703533 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:24:38.703498 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:24:51.105328 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:24:51.105241 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:24:59.098316 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:24:59.098286 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:25:11.488127 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:25:11.488095 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:25:33.710937 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:25:33.710898 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:25:43.088424 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:25:43.088385 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:25:52.513383 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:25:52.513350 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:26:03.888940 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:26:03.888908 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:26:18.489815 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:26:18.489722 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:26:28.290244 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:26:28.290210 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:26:37.998625 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:26:37.998592 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:26:45.897040 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:26:45.897005 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:26:55.493062 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:26:55.493029 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:27:05.195507 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:27:05.195472 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:27:19.499949 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:27:19.499916 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:27:24.512706 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:27:24.512675 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:27:24.514297 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:27:24.514273 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:27:28.990791 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:27:28.990752 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:27:43.600807 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:27:43.600774 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:27:52.598209 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:27:52.598107 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:28:04.690681 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:28:04.690641 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:28:19.898221 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:28:19.898180 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:28:32.199207 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:28:32.199174 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:28:42.088144 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:28:42.088110 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:28:55.285943 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:28:55.285907 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:29:07.090209 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:29:07.090178 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:29:17.689455 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:29:17.689410 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:29:28.304327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:29:28.304294 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:29:48.189516 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:29:48.189476 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:29:56.700351 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:29:56.700318 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:31:18.789848 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:31:18.789810 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:31:27.431432 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:31:27.431397 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:31:37.598421 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:31:37.598386 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:31:49.290879 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:31:49.290844 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:32:21.801164 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:32:21.801087 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:32:24.542632 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:32:24.542604 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:32:24.545813 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:32:24.545785 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:32:40.691145 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:32:40.691113 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:32:54.399266 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:32:54.399234 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:33:09.193021 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:33:09.192984 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:33:43.218699 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:33:43.218663 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:33:59.503133 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:33:59.503097 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:34:07.520604 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:34:07.520568 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:34:56.330950 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:34:56.330912 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:35:07.514573 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:07.514540 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:35:10.089568 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.089535 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5"] Jul 09 07:35:10.093342 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.093319 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.097327 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.097306 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9c5220\"/\"test-model-9c5220-kserve-self-signed-certs\"" Jul 09 07:35:10.097463 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.097351 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9c5220\"/\"openshift-service-ca.crt\"" Jul 09 07:35:10.097463 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.097306 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9c5220\"/\"kube-root-ca.crt\"" Jul 09 07:35:10.097463 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.097401 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9c5220\"/\"default-dockercfg-gv5rc\"" Jul 09 07:35:10.104890 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.104867 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5"] Jul 09 07:35:10.234689 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.234656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-home\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.234689 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.234696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-tmp-dir\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.234987 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.234716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-dshm\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.234987 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.234755 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b093ed8-064c-4875-a88e-8a20a21aeee2-tls-certs\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.234987 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.234826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vb7t\" (UniqueName: \"kubernetes.io/projected/8b093ed8-064c-4875-a88e-8a20a21aeee2-kube-api-access-5vb7t\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.234987 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.234886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-model-cache\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.335634 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.335607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-tmp-dir\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.335634 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.335635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-dshm\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.335858 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.335657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b093ed8-064c-4875-a88e-8a20a21aeee2-tls-certs\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.335858 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.335771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vb7t\" (UniqueName: \"kubernetes.io/projected/8b093ed8-064c-4875-a88e-8a20a21aeee2-kube-api-access-5vb7t\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.335858 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.335827 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-model-cache\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.336007 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.335962 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-home\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.336093 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.336073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-tmp-dir\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.336223 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.336205 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-model-cache\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.336283 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.336215 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-home\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.338277 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.338259 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-dshm\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.338634 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.338612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b093ed8-064c-4875-a88e-8a20a21aeee2-tls-certs\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.345375 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.345321 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vb7t\" (UniqueName: \"kubernetes.io/projected/8b093ed8-064c-4875-a88e-8a20a21aeee2-kube-api-access-5vb7t\") pod \"test-model-9c5220-kserve-7fc7c799d7-5ppd5\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.403379 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.403356 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:10.552148 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.552117 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5"] Jul 09 07:35:10.553695 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:35:10.553670 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b093ed8_064c_4875_a88e_8a20a21aeee2.slice/crio-d108b43b2f82df8605dbac3ce13650c0f717edbd09a0db116448a6ab426cfa71 WatchSource:0}: Error finding container d108b43b2f82df8605dbac3ce13650c0f717edbd09a0db116448a6ab426cfa71: Status 404 returned error can't find the container with id d108b43b2f82df8605dbac3ce13650c0f717edbd09a0db116448a6ab426cfa71 Jul 09 07:35:10.942321 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.942238 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" event={"ID":"8b093ed8-064c-4875-a88e-8a20a21aeee2","Type":"ContainerStarted","Data":"02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f"} Jul 09 07:35:10.942321 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.942279 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" event={"ID":"8b093ed8-064c-4875-a88e-8a20a21aeee2","Type":"ContainerStarted","Data":"d108b43b2f82df8605dbac3ce13650c0f717edbd09a0db116448a6ab426cfa71"} Jul 09 07:35:10.970906 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:10.970851 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" podStartSLOduration=0.970831429 podStartE2EDuration="970.831429ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 07:35:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:35:10.966472937 +0000 UTC m=+1966.970144570" watchObservedRunningTime="2026-07-09 07:35:10.970831429 +0000 UTC m=+1966.974503064" Jul 09 07:35:15.118674 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:15.118642 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:35:20.403752 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:20.403656 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:20.403752 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:20.403705 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:20.415866 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:20.415846 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:20.998526 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:20.998496 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:35:41.801691 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:41.801661 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:35:53.772620 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:53.772583 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5"] Jul 09 07:35:58.691830 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:35:58.691792 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:36:08.792179 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:08.792124 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" podUID="8b093ed8-064c-4875-a88e-8a20a21aeee2" containerName="main" containerID="cri-o://02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f" gracePeriod=45 Jul 09 07:36:09.045372 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.045316 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:36:09.156349 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.156316 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-home\") pod \"8b093ed8-064c-4875-a88e-8a20a21aeee2\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " Jul 09 07:36:09.156501 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.156410 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vb7t\" (UniqueName: \"kubernetes.io/projected/8b093ed8-064c-4875-a88e-8a20a21aeee2-kube-api-access-5vb7t\") pod \"8b093ed8-064c-4875-a88e-8a20a21aeee2\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " Jul 09 07:36:09.156501 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.156455 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-tmp-dir\") pod \"8b093ed8-064c-4875-a88e-8a20a21aeee2\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " Jul 09 07:36:09.156501 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.156492 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-model-cache\") pod \"8b093ed8-064c-4875-a88e-8a20a21aeee2\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " Jul 09 07:36:09.156625 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.156511 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b093ed8-064c-4875-a88e-8a20a21aeee2-tls-certs\") pod \"8b093ed8-064c-4875-a88e-8a20a21aeee2\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " Jul 09 07:36:09.156625 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.156545 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-dshm\") pod \"8b093ed8-064c-4875-a88e-8a20a21aeee2\" (UID: \"8b093ed8-064c-4875-a88e-8a20a21aeee2\") " Jul 09 07:36:09.156625 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.156559 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-home" (OuterVolumeSpecName: "home") pod "8b093ed8-064c-4875-a88e-8a20a21aeee2" (UID: "8b093ed8-064c-4875-a88e-8a20a21aeee2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 07:36:09.156818 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.156725 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-model-cache" (OuterVolumeSpecName: "model-cache") pod "8b093ed8-064c-4875-a88e-8a20a21aeee2" (UID: "8b093ed8-064c-4875-a88e-8a20a21aeee2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 07:36:09.156865 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.156810 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8b093ed8-064c-4875-a88e-8a20a21aeee2" (UID: "8b093ed8-064c-4875-a88e-8a20a21aeee2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 07:36:09.156910 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.156891 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-model-cache\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:36:09.156952 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.156914 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-home\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:36:09.158560 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.158538 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b093ed8-064c-4875-a88e-8a20a21aeee2-kube-api-access-5vb7t" (OuterVolumeSpecName: "kube-api-access-5vb7t") pod "8b093ed8-064c-4875-a88e-8a20a21aeee2" (UID: "8b093ed8-064c-4875-a88e-8a20a21aeee2"). InnerVolumeSpecName "kube-api-access-5vb7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 07:36:09.158666 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.158638 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-dshm" (OuterVolumeSpecName: "dshm") pod "8b093ed8-064c-4875-a88e-8a20a21aeee2" (UID: "8b093ed8-064c-4875-a88e-8a20a21aeee2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 07:36:09.158666 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.158648 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b093ed8-064c-4875-a88e-8a20a21aeee2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8b093ed8-064c-4875-a88e-8a20a21aeee2" (UID: "8b093ed8-064c-4875-a88e-8a20a21aeee2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 07:36:09.221250 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.221219 2565 generic.go:356] "Generic (PLEG): container finished" podID="8b093ed8-064c-4875-a88e-8a20a21aeee2" containerID="02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f" exitCode=0 Jul 09 07:36:09.221395 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.221259 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" Jul 09 07:36:09.221395 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.221267 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" event={"ID":"8b093ed8-064c-4875-a88e-8a20a21aeee2","Type":"ContainerDied","Data":"02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f"} Jul 09 07:36:09.221395 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.221297 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5" event={"ID":"8b093ed8-064c-4875-a88e-8a20a21aeee2","Type":"ContainerDied","Data":"d108b43b2f82df8605dbac3ce13650c0f717edbd09a0db116448a6ab426cfa71"} Jul 09 07:36:09.221395 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.221313 2565 scope.go:117] "RemoveContainer" containerID="02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f" Jul 09 07:36:09.231149 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.231134 2565 scope.go:117] "RemoveContainer" containerID="02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f" Jul 09 07:36:09.231400 ip-10-0-137-118 kubenswrapper[2565]: E0709 07:36:09.231384 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f\": container with ID starting with 02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f not found: ID does not exist" containerID="02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f" Jul 09 07:36:09.231453 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.231409 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f"} err="failed to get container status \"02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f\": rpc error: code = NotFound desc = could not find container \"02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f\": container with ID starting with 02fb31f03cee5aedc461a178734630d67cabdfb39cc72dc583a4bb48da75776f not found: ID does not exist" Jul 09 07:36:09.244124 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.244100 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5"] Jul 09 07:36:09.248105 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.248080 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-9c5220/test-model-9c5220-kserve-7fc7c799d7-5ppd5"] Jul 09 07:36:09.257664 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.257640 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b093ed8-064c-4875-a88e-8a20a21aeee2-tls-certs\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:36:09.257664 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.257663 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-dshm\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:36:09.257834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.257676 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vb7t\" (UniqueName: \"kubernetes.io/projected/8b093ed8-064c-4875-a88e-8a20a21aeee2-kube-api-access-5vb7t\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:36:09.257834 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:09.257692 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b093ed8-064c-4875-a88e-8a20a21aeee2-tmp-dir\") on node \"ip-10-0-137-118.ec2.internal\" DevicePath \"\"" Jul 09 07:36:10.526839 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:10.526803 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b093ed8-064c-4875-a88e-8a20a21aeee2" path="/var/lib/kubelet/pods/8b093ed8-064c-4875-a88e-8a20a21aeee2/volumes" Jul 09 07:36:41.998196 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:41.998163 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:36:56.393260 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:36:56.393179 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:37:13.500988 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:37:13.500949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:37:24.579992 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:37:24.579956 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:37:24.583993 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:37:24.583969 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:37:28.795894 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:37:28.795858 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:37:42.491237 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:37:42.491199 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:40:48.790271 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:40:48.790232 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:41:01.394423 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:01.394387 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zqjm5"] Jul 09 07:41:04.770049 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:04.770025 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b96c58b47-nr5sd_dc99e37d-8a39-49d6-94a5-e3c00bae5626/copy-manifests/0.log" Jul 09 07:41:04.784074 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:04.784052 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b96c58b47-nr5sd_dc99e37d-8a39-49d6-94a5-e3c00bae5626/manager/0.log" Jul 09 07:41:06.586763 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:06.586720 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ngn92_e8a65fe3-66d6-4f55-b9f0-83398a80d8a6/kuadrant-console-plugin/0.log" Jul 09 07:41:06.946299 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:06.946224 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zqjm5_c2be787d-1014-4806-8456-98bd99e68b19/limitador/0.log" Jul 09 07:41:07.782542 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:07.782513 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f58fd5d48-xmr6s_a93b1d30-adcd-4a00-b429-34c73c07c770/kube-auth-proxy/0.log" Jul 09 07:41:08.280457 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:08.280431 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f48c84f45-4pdpl_62bc8364-fc00-42b4-8e18-e5c30b3fbb15/router/0.log" Jul 09 07:41:08.862076 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:08.862050 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tz8lx_6dc9317a-81da-42ed-8992-bba2be1c1cf0/main/0.log" Jul 09 07:41:08.978219 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:08.978196 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr62d4_a21e405e-984d-44dd-a85e-8d5509a59376/main/0.log" Jul 09 07:41:09.095699 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:09.095670 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ldmrb_a5e6059e-c796-41b6-8517-ccf6890919e5/main/0.log" Jul 09 07:41:09.206044 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:09.205975 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-lg7zc_022931de-d7ae-4fe8-aff6-a3c9f60bce4c/main/0.log" Jul 09 07:41:16.754073 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:16.754004 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xbl78_31b9f6a6-e642-410d-8e01-975cace6de3b/global-pull-secret-syncer/0.log" Jul 09 07:41:16.882695 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:16.882668 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wn466_5b971b01-9e66-4de5-819e-f83aaa6995d6/konnectivity-agent/0.log" Jul 09 07:41:16.904376 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:16.904350 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-118.ec2.internal_e23d70a312ac711b759fd35bb366a792/haproxy/0.log" Jul 09 07:41:22.186331 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:22.186305 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ngn92_e8a65fe3-66d6-4f55-b9f0-83398a80d8a6/kuadrant-console-plugin/0.log" Jul 09 07:41:22.466477 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:22.466398 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zqjm5_c2be787d-1014-4806-8456-98bd99e68b19/limitador/0.log" Jul 09 07:41:24.308110 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:24.308083 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9f89738-2269-4dfd-9d04-4118bbdaf72b/alertmanager/0.log" Jul 09 07:41:24.336810 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:24.336784 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9f89738-2269-4dfd-9d04-4118bbdaf72b/config-reloader/0.log" Jul 09 07:41:24.394635 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:24.394609 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9f89738-2269-4dfd-9d04-4118bbdaf72b/kube-rbac-proxy-web/0.log" Jul 09 07:41:24.424822 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:24.424805 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9f89738-2269-4dfd-9d04-4118bbdaf72b/kube-rbac-proxy/0.log" Jul 09 07:41:24.450897 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:24.450877 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9f89738-2269-4dfd-9d04-4118bbdaf72b/kube-rbac-proxy-metric/0.log" Jul 09 07:41:24.474328 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:24.474297 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9f89738-2269-4dfd-9d04-4118bbdaf72b/prom-label-proxy/0.log" Jul 09 07:41:24.500538 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:24.500501 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9f89738-2269-4dfd-9d04-4118bbdaf72b/init-config-reloader/0.log" Jul 09 07:41:24.543858 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:24.543794 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-bxkcw_4f1db7b2-77fb-4e70-93c3-01ca47c88100/cluster-monitoring-operator/0.log" Jul 09 07:41:24.828278 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:24.828256 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcd84_7c709106-2536-4037-acf4-2a5b51489b22/node-exporter/0.log" Jul 09 07:41:24.855342 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:24.855321 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcd84_7c709106-2536-4037-acf4-2a5b51489b22/kube-rbac-proxy/0.log" Jul 09 07:41:24.881814 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:24.881796 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcd84_7c709106-2536-4037-acf4-2a5b51489b22/init-textfile/0.log" Jul 09 07:41:25.078335 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.078232 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3b71775-306c-4203-9f71-0a82f2f3bc71/prometheus/0.log" Jul 09 07:41:25.101467 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.101440 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3b71775-306c-4203-9f71-0a82f2f3bc71/config-reloader/0.log" Jul 09 07:41:25.127183 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.127156 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3b71775-306c-4203-9f71-0a82f2f3bc71/thanos-sidecar/0.log" Jul 09 07:41:25.152025 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.152002 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3b71775-306c-4203-9f71-0a82f2f3bc71/kube-rbac-proxy-web/0.log" Jul 09 07:41:25.175396 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.175377 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3b71775-306c-4203-9f71-0a82f2f3bc71/kube-rbac-proxy/0.log" Jul 09 07:41:25.199989 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.199966 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3b71775-306c-4203-9f71-0a82f2f3bc71/kube-rbac-proxy-thanos/0.log" Jul 09 07:41:25.228023 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.227982 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3b71775-306c-4203-9f71-0a82f2f3bc71/init-config-reloader/0.log" Jul 09 07:41:25.365533 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.365468 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cb5b8765f-jfqnd_87fc3679-fb6c-4348-9c20-195279069088/telemeter-client/0.log" Jul 09 07:41:25.391229 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.391206 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cb5b8765f-jfqnd_87fc3679-fb6c-4348-9c20-195279069088/reload/0.log" Jul 09 07:41:25.416425 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.416403 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cb5b8765f-jfqnd_87fc3679-fb6c-4348-9c20-195279069088/kube-rbac-proxy/0.log" Jul 09 07:41:25.455553 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.455528 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58958d54cb-wtzn4_33b66344-658b-48df-aa0f-6b273b44ff71/thanos-query/0.log" Jul 09 07:41:25.476520 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.476501 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58958d54cb-wtzn4_33b66344-658b-48df-aa0f-6b273b44ff71/kube-rbac-proxy-web/0.log" Jul 09 07:41:25.499166 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.499147 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58958d54cb-wtzn4_33b66344-658b-48df-aa0f-6b273b44ff71/kube-rbac-proxy/0.log" Jul 09 07:41:25.520506 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.520482 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58958d54cb-wtzn4_33b66344-658b-48df-aa0f-6b273b44ff71/prom-label-proxy/0.log" Jul 09 07:41:25.542205 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.542187 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58958d54cb-wtzn4_33b66344-658b-48df-aa0f-6b273b44ff71/kube-rbac-proxy-rules/0.log" Jul 09 07:41:25.565787 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:25.565768 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58958d54cb-wtzn4_33b66344-658b-48df-aa0f-6b273b44ff71/kube-rbac-proxy-metrics/0.log" Jul 09 07:41:26.735672 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.735645 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-7g8lj_f62e9f63-ef1f-4906-8a5b-19047a9e69b6/networking-console-plugin/0.log" Jul 09 07:41:26.887688 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.887658 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj"] Jul 09 07:41:26.888070 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.888058 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b093ed8-064c-4875-a88e-8a20a21aeee2" containerName="main" Jul 09 07:41:26.888070 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.888071 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b093ed8-064c-4875-a88e-8a20a21aeee2" containerName="main" Jul 09 07:41:26.888152 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.888136 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b093ed8-064c-4875-a88e-8a20a21aeee2" containerName="main" Jul 09 07:41:26.891330 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.891315 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:26.894178 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.894157 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s54zf\"/\"openshift-service-ca.crt\"" Jul 09 07:41:26.894305 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.894197 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s54zf\"/\"kube-root-ca.crt\"" Jul 09 07:41:26.895177 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.895141 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s54zf\"/\"default-dockercfg-tqqpq\"" Jul 09 07:41:26.902809 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.902791 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj"] Jul 09 07:41:26.951256 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.951231 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-podres\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:26.951363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.951331 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjvdd\" (UniqueName: \"kubernetes.io/projected/813a4159-b1b7-468f-a87d-cef3075d5572-kube-api-access-sjvdd\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:26.951363 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.951355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-sys\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:26.951433 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.951396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-lib-modules\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:26.951433 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:26.951418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-proc\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.051965 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.051941 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjvdd\" (UniqueName: \"kubernetes.io/projected/813a4159-b1b7-468f-a87d-cef3075d5572-kube-api-access-sjvdd\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.052072 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.051972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-sys\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.052072 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.051997 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-lib-modules\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.052072 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.052022 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-proc\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.052072 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.052059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-podres\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.052219 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.052071 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-sys\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.052219 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.052136 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-lib-modules\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.052219 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.052150 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-proc\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.052219 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.052170 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/813a4159-b1b7-468f-a87d-cef3075d5572-podres\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.060081 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.060060 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjvdd\" (UniqueName: \"kubernetes.io/projected/813a4159-b1b7-468f-a87d-cef3075d5572-kube-api-access-sjvdd\") pod \"perf-node-gather-daemonset-2mrpj\" (UID: \"813a4159-b1b7-468f-a87d-cef3075d5572\") " pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.201893 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.201853 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.332624 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.332595 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj"] Jul 09 07:41:27.334722 ip-10-0-137-118 kubenswrapper[2565]: W0709 07:41:27.334680 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod813a4159_b1b7_468f_a87d_cef3075d5572.slice/crio-50736895cc8e832d3747d97add88e9e92c02bed3a30fad96e9fc7288a85c38d7 WatchSource:0}: Error finding container 50736895cc8e832d3747d97add88e9e92c02bed3a30fad96e9fc7288a85c38d7: Status 404 returned error can't find the container with id 50736895cc8e832d3747d97add88e9e92c02bed3a30fad96e9fc7288a85c38d7 Jul 09 07:41:27.335650 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.335630 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/1.log" Jul 09 07:41:27.340070 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.340053 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vnj9j_023abe38-620c-4d2e-8cf4-990b2b3bc35d/console-operator/2.log" Jul 09 07:41:27.775515 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.775429 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" event={"ID":"813a4159-b1b7-468f-a87d-cef3075d5572","Type":"ContainerStarted","Data":"10de8cdd4e3ee2d3279d68d23cf19e5111096357c3b4cc69a67ce2dc460aa130"} Jul 09 07:41:27.775515 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.775482 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" event={"ID":"813a4159-b1b7-468f-a87d-cef3075d5572","Type":"ContainerStarted","Data":"50736895cc8e832d3747d97add88e9e92c02bed3a30fad96e9fc7288a85c38d7"} Jul 09 07:41:27.776016 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.775533 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:27.792889 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.792845 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" podStartSLOduration=1.7928300130000001 podStartE2EDuration="1.792830013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 07:41:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 07:41:27.792484327 +0000 UTC m=+2343.796155963" watchObservedRunningTime="2026-07-09 07:41:27.792830013 +0000 UTC m=+2343.796501646" Jul 09 07:41:27.857639 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:27.857614 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-qxfxl_d1147087-94cd-4db1-b695-512accd102f7/download-server/0.log" Jul 09 07:41:28.472963 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:28.472896 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-pxmdp_eb8bcf2d-5a87-42e3-a544-293f84ed1a33/volume-data-source-validator/0.log" Jul 09 07:41:29.516485 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:29.516452 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4z2f_e40f8186-5321-4692-8303-24eb101a2fdb/dns/0.log" Jul 09 07:41:29.537008 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:29.536983 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4z2f_e40f8186-5321-4692-8303-24eb101a2fdb/kube-rbac-proxy/0.log" Jul 09 07:41:29.663917 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:29.663885 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j8fml_8ec102ca-2f18-441e-bd65-8aaf7a925887/dns-node-resolver/0.log" Jul 09 07:41:30.332233 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:30.332196 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rjps9_60fb5c1d-e3d7-4d4c-b356-58ff313ae286/node-ca/0.log" Jul 09 07:41:31.532580 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:31.532548 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f58fd5d48-xmr6s_a93b1d30-adcd-4a00-b429-34c73c07c770/kube-auth-proxy/0.log" Jul 09 07:41:31.789576 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:31.789482 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f48c84f45-4pdpl_62bc8364-fc00-42b4-8e18-e5c30b3fbb15/router/0.log" Jul 09 07:41:32.521246 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:32.521221 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h82ff_01fa2a56-c1cc-4509-b017-989d6363d2cf/serve-healthcheck-canary/0.log" Jul 09 07:41:32.999199 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:32.999172 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-m5h6q_69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d/insights-operator/0.log" Jul 09 07:41:32.999588 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:32.999462 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-m5h6q_69f5e4ec-b94a-4d0d-9e4b-ee6763609a9d/insights-operator/1.log" Jul 09 07:41:33.170259 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:33.170231 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zb5qf_67b7f45a-88af-4a28-af89-864b69fc0da1/kube-rbac-proxy/0.log" Jul 09 07:41:33.192817 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:33.192699 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zb5qf_67b7f45a-88af-4a28-af89-864b69fc0da1/exporter/0.log" Jul 09 07:41:33.217008 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:33.216980 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zb5qf_67b7f45a-88af-4a28-af89-864b69fc0da1/extractor/0.log" Jul 09 07:41:33.790610 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:33.790582 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s54zf/perf-node-gather-daemonset-2mrpj" Jul 09 07:41:36.197894 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:36.197861 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b96c58b47-nr5sd_dc99e37d-8a39-49d6-94a5-e3c00bae5626/manager/0.log" Jul 09 07:41:36.214640 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:36.214615 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b96c58b47-nr5sd_dc99e37d-8a39-49d6-94a5-e3c00bae5626/copy-manifests/0.log" Jul 09 07:41:37.634382 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:37.634353 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bbcbb4454-nfgvv_662bd347-b1f6-424b-845f-cb4f09b74c8b/manager/0.log" Jul 09 07:41:37.739219 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:37.739192 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f58fd5d48-xmr6s_a93b1d30-adcd-4a00-b429-34c73c07c770/kube-auth-proxy/0.log" Jul 09 07:41:37.954963 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:37.954892 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f48c84f45-4pdpl_62bc8364-fc00-42b4-8e18-e5c30b3fbb15/router/0.log" Jul 09 07:41:39.293939 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:39.293906 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f58fd5d48-xmr6s_a93b1d30-adcd-4a00-b429-34c73c07c770/kube-auth-proxy/0.log" Jul 09 07:41:39.530144 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:39.530103 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f48c84f45-4pdpl_62bc8364-fc00-42b4-8e18-e5c30b3fbb15/router/0.log" Jul 09 07:41:43.006345 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:43.006318 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-fwvlw_546495c0-daf9-46dd-b67f-89e0fff7fd2d/kube-storage-version-migrator-operator/1.log" Jul 09 07:41:43.007190 ip-10-0-137-118 kubenswrapper[2565]: I0709 07:41:43.007168 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-fwvlw_546495c0-daf9-46dd-b67f-89e0fff7fd2d/kube-storage-version-migrator-operator/0.log"