Jul 09 16:01:47.893308 ip-10-0-136-0 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 16:01:47.893321 ip-10-0-136-0 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 16:01:47.893328 ip-10-0-136-0 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 16:01:47.893549 ip-10-0-136-0 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 16:01:58.033418 ip-10-0-136-0 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 16:01:58.033436 ip-10-0-136-0 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 36f4947cc50047a48e9acbc8417dec80 -- Jul 09 16:03:42.799781 ip-10-0-136-0 systemd[1]: Starting Kubernetes Kubelet... Jul 09 16:03:43.243420 ip-10-0-136-0 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:03:43.243420 ip-10-0-136-0 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 16:03:43.243420 ip-10-0-136-0 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:03:43.243420 ip-10-0-136-0 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 16:03:43.243420 ip-10-0-136-0 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:03:43.245670 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.245520 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 16:03:43.251744 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251721 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:03:43.251744 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251739 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:03:43.251744 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251743 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:03:43.251744 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251746 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:03:43.251744 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251749 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251752 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251755 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251757 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251760 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251763 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251765 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251768 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251770 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251773 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251776 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251778 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251781 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251783 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251785 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251788 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251790 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251793 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251795 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:03:43.251931 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251797 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251800 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251802 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251805 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251814 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251819 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251822 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251824 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251830 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251835 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251839 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251842 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251845 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251849 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251853 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251856 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251860 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251864 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:03:43.252400 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251868 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251870 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251873 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251877 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251880 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251883 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251885 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251888 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251890 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251893 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251895 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251898 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251901 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251903 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251906 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251908 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251911 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251913 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251916 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251919 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:03:43.252865 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251922 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251925 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251927 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251930 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251933 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251935 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251938 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251940 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251943 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251945 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251948 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251951 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251953 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251955 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251957 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251960 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251963 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251965 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251967 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251969 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:03:43.253337 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251972 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251974 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251977 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251980 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251982 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251984 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251986 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251989 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251991 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251993 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251996 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.251998 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.252000 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.252003 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.252006 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.252008 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.252011 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.252013 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253638 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253646 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:03:43.253830 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253649 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253654 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253658 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253661 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253663 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253666 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253668 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253671 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253673 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253676 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253679 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253681 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253684 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253687 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253690 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253694 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253697 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253699 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253702 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253704 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:03:43.254296 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253707 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253709 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253711 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253714 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253717 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253719 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253722 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253725 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253727 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253730 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253734 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253737 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253741 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253744 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253746 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253749 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253752 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253754 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253756 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:03:43.254834 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253759 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253762 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253764 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253766 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253769 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253772 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253774 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253778 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253781 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253784 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253786 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253789 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253791 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253794 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253796 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253799 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253801 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253803 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253807 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253809 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:03:43.255284 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253811 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253814 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253816 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253819 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253822 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253824 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253827 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253829 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253832 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253834 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253837 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253839 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253842 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253844 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253847 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253849 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253852 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253854 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253857 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253860 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:03:43.255789 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253863 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253865 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253868 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253870 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253873 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253875 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253879 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253881 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253884 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253886 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253889 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253891 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253894 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253896 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253899 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253902 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253905 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.253909 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255171 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:03:43.256279 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255178 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255182 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255184 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255187 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255190 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255192 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255194 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255197 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255199 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255202 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255205 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255207 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255210 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255213 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255217 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255221 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255224 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255226 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255230 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255232 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:03:43.256749 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255235 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255237 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255240 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255242 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255245 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255248 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255250 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255252 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255255 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255257 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255260 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255262 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255265 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255267 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255270 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255272 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255274 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255277 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255279 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:03:43.257221 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255282 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255284 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255287 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255290 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255292 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255295 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255298 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255301 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255304 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255315 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255318 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255321 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255323 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255326 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255329 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255331 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255334 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255337 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255339 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:03:43.257687 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255342 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255344 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255347 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255349 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255352 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255356 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255359 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255363 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255365 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255368 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255371 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255373 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255375 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255378 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255381 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255383 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255385 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255388 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255391 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:03:43.258202 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255394 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255396 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255399 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255401 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255409 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255411 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255414 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255416 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255419 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255421 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255424 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255428 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255431 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255433 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255436 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255438 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255441 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255443 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255446 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255448 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.255450 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:03:43.258673 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255535 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255543 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255548 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255552 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255556 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255559 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255563 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255567 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255570 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255573 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255576 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255579 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255582 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255585 2581 flags.go:64] FLAG: --cgroup-root="" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255587 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255590 2581 flags.go:64] FLAG: --client-ca-file="" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255593 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255596 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255600 2581 flags.go:64] FLAG: --cluster-domain="" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255603 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255606 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255609 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255612 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255620 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 16:03:43.259151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255623 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255626 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255629 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255632 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255635 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255637 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255640 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255643 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255647 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255650 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255653 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255655 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255658 2581 flags.go:64] FLAG: --enable-server="true" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255660 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255665 2581 flags.go:64] FLAG: --event-burst="100" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255667 2581 flags.go:64] FLAG: --event-qps="50" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255670 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255673 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255676 2581 flags.go:64] FLAG: --eviction-hard="" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255680 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255683 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255686 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255689 2581 flags.go:64] FLAG: --eviction-soft="" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255691 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255694 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 16:03:43.259744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255698 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255700 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255703 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255706 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255709 2581 flags.go:64] FLAG: --feature-gates="" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255712 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255715 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255717 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255721 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255723 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255726 2581 flags.go:64] FLAG: --help="false" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255729 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255732 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255735 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255737 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255740 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255743 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255746 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255749 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255751 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255754 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255756 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255759 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255762 2581 flags.go:64] FLAG: --kube-reserved="" Jul 09 16:03:43.260394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255765 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255767 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255770 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255773 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255775 2581 flags.go:64] FLAG: --lock-file="" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255778 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255781 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255783 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255789 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255792 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255795 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255798 2581 flags.go:64] FLAG: --logging-format="text" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255801 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255805 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255814 2581 flags.go:64] FLAG: --manifest-url="" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255818 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255822 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255825 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255829 2581 flags.go:64] FLAG: --max-pods="110" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255832 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255835 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255837 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255840 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255843 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255846 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 16:03:43.260996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255848 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255856 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255858 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255861 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255864 2581 flags.go:64] FLAG: --pod-cidr="" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255866 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255872 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255875 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255877 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255880 2581 flags.go:64] FLAG: --port="10250" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255883 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255886 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c411c0d02d751cc4" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255891 2581 flags.go:64] FLAG: --qos-reserved="" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255894 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255897 2581 flags.go:64] FLAG: --register-node="true" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255900 2581 flags.go:64] FLAG: --register-with-taints="" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255903 2581 flags.go:64] FLAG: --registry-burst="10" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255907 2581 flags.go:64] FLAG: --registry-qps="5" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255909 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255912 2581 flags.go:64] FLAG: --reserved-memory="" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255915 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255918 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255921 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255924 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255926 2581 flags.go:64] FLAG: --runonce="false" Jul 09 16:03:43.261612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255929 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255932 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255935 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255937 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255940 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255943 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255946 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255948 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255951 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255954 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255956 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255959 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255962 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255966 2581 flags.go:64] FLAG: --system-cgroups="" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255969 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255974 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255977 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255979 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255986 2581 flags.go:64] FLAG: --tls-min-version="" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255990 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255993 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255995 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.255998 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.256001 2581 flags.go:64] FLAG: --v="2" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.256005 2581 flags.go:64] FLAG: --version="false" Jul 09 16:03:43.262206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.256009 2581 flags.go:64] FLAG: --vmodule="" Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.256013 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.256016 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256139 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256143 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256145 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256148 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256150 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256153 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256155 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256158 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256160 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256163 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256166 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256168 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256171 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256173 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256176 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256178 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:03:43.262821 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256181 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256187 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256190 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256193 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256196 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256198 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256201 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256205 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256209 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256213 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256216 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256219 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256222 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256224 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256228 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256231 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256233 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256236 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256239 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:03:43.263314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256242 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256244 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256246 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256250 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256254 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256257 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256259 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256262 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256265 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256267 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256269 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256272 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256275 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256277 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256281 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256284 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256286 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256289 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256292 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:03:43.263826 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256294 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256298 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256301 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256303 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256306 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256308 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256311 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256313 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256316 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256321 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256324 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256326 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256329 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256331 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256334 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256337 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256339 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256342 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256345 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256347 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:03:43.264285 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256350 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256352 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256355 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256357 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256359 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256361 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256364 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256368 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256371 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256373 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256375 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256378 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256380 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256384 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256387 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256389 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256392 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256394 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256397 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256399 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:03:43.264787 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256401 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256404 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256407 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256409 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.256412 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.257207 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.264804 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.264822 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.264841 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.264847 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264907 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264912 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264915 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264918 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264921 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:03:43.265264 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264924 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264927 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264930 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264933 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264936 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264940 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264944 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264947 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264950 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264952 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264955 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264958 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264960 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264963 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264965 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264968 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264970 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264972 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264975 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:03:43.265660 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264977 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264980 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264982 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264984 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264990 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264995 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.264997 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265000 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265003 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265006 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265009 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265012 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265014 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265017 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265020 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265023 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265026 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265029 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265031 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:03:43.266100 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265034 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265037 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265039 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265043 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265047 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265049 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265052 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265054 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265057 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265059 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265062 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265064 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265067 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265069 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265072 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265074 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265077 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265080 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265083 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265086 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:03:43.266573 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265088 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265090 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265093 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265095 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265098 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265100 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265103 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265105 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265107 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265110 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265112 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265115 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265117 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265119 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265122 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265124 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265127 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265129 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265131 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265134 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:03:43.267045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265136 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265138 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265141 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265143 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265145 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265148 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265150 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265153 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265155 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265158 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265161 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265163 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265172 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265174 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265177 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:03:43.267560 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265179 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.265184 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265347 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265352 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265356 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265359 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265362 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265364 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265366 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265369 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265371 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265373 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265376 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265378 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265381 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:03:43.267920 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265383 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265386 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265388 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265390 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265393 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265395 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265397 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265400 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265402 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265405 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265407 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265410 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265412 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265415 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265417 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265425 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265428 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265431 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265433 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265435 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:03:43.268290 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265438 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265440 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265442 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265445 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265447 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265449 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265451 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265454 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265456 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265459 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265461 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265482 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265485 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265487 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265490 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265492 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265494 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265497 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265499 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265501 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:03:43.268783 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265504 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265508 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265512 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265516 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265519 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265522 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265524 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265527 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265537 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265540 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265542 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265544 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265547 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265550 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265552 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265554 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265557 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265559 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265562 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:03:43.269269 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265564 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265566 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265568 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265571 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265573 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265576 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265578 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265580 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265583 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265585 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265588 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265590 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265592 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265595 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265597 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265599 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265602 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265605 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265607 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265610 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:03:43.269772 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265612 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:03:43.270252 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265614 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:03:43.270252 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265622 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:03:43.270252 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265625 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:03:43.270252 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265627 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:03:43.270252 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265629 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:03:43.270252 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:43.265632 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:03:43.270252 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.265636 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:03:43.270252 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.265765 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 16:03:43.270252 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.269178 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 16:03:43.270933 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.270920 2581 server.go:1019] "Starting client certificate rotation" Jul 09 16:03:43.271086 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.271068 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 16:03:43.271145 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.271125 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 16:03:43.274023 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.274007 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 16:03:43.278411 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.278387 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 16:03:43.289637 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.289621 2581 log.go:25] "Validated CRI v1 runtime API" Jul 09 16:03:43.294060 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.294045 2581 log.go:25] "Validated CRI v1 image API" Jul 09 16:03:43.295010 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.294990 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 16:03:43.298637 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.298618 2581 fs.go:135] Filesystem UUIDs: map[0ff4f671-8653-43a1-8651-be6cc00e53b7:/dev/nvme0n1p3 583f718f-26e0-494c-94af-5f6ee736d89f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 09 16:03:43.298699 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.298637 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 16:03:43.304679 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.304567 2581 manager.go:216] Machine: {Timestamp:2026-07-09 16:03:43.30312679 +0000 UTC m=+0.374722751 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101712 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ed25afb068c9393423a26337b0b79 SystemUUID:ec2ed25a-fb06-8c93-9342-3a26337b0b79 BootID:36f4947c-c500-47a4-8e9a-cbc8417dec80 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:79:6d:b1:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:79:6d:b1:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:f5:f9:01:6a:cf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 16:03:43.304679 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.304676 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 16:03:43.304786 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.304762 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 16:03:43.307757 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.307730 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 16:03:43.307926 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.307760 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 16:03:43.308617 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.308606 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 16:03:43.308647 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.308619 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 16:03:43.308647 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.308627 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 16:03:43.308647 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.308641 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 16:03:43.310558 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.310547 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 16:03:43.314153 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.314142 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 09 16:03:43.314310 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.314301 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 16:03:43.314339 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.314331 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 09 16:03:43.314373 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.314342 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 16:03:43.314373 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.314370 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 16:03:43.314429 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.314382 2581 kubelet.go:398] "Adding apiserver pod source" Jul 09 16:03:43.314429 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.314396 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 16:03:43.314855 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.314844 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 16:03:43.314906 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.314861 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 16:03:43.316020 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.315998 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 16:03:43.317344 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.317325 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 16:03:43.321189 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.321169 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 16:03:43.321254 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.321205 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 16:03:43.321433 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.321417 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 16:03:43.321433 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.321436 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 16:03:43.321557 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.321443 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 16:03:43.321557 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.321449 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 16:03:43.321557 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.321458 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 16:03:43.321557 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.321496 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 16:03:43.322047 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.322037 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 16:03:43.322080 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.322048 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 16:03:43.322080 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.322057 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 16:03:43.322080 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.322063 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 16:03:43.322080 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.322072 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 16:03:43.322080 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.322079 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 16:03:43.323292 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.323275 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 16:03:43.323347 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.323306 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 16:03:43.325729 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.325705 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 16:03:43.325729 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.325722 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 16:03:43.325871 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.325852 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 16:03:43.326650 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.326638 2581 server.go:1268] "Started kubelet" Jul 09 16:03:43.326735 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.326714 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 16:03:43.327021 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.326715 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 16:03:43.327021 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.326916 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 16:03:43.327665 ip-10-0-136-0 systemd[1]: Started Kubernetes Kubelet. Jul 09 16:03:43.328289 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.328274 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 16:03:43.329839 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.329825 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 09 16:03:43.332091 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.332071 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 16:03:43.333325 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.332201 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18c0aa9840249a4d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-07-09 16:03:43.326607949 +0000 UTC m=+0.398203890,LastTimestamp:2026-07-09 16:03:43.326607949 +0000 UTC m=+0.398203890,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}" Jul 09 16:03:43.337234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.337215 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 16:03:43.337327 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.337233 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 16:03:43.337327 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.337299 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:43.337932 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.337920 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 16:03:43.338040 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.338030 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 16:03:43.339710 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.338142 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 16:03:43.339798 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.339782 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 09 16:03:43.339798 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.339798 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 09 16:03:43.340435 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.340418 2581 factory.go:55] Registering systemd factory Jul 09 16:03:43.340542 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.340438 2581 factory.go:223] Registration of the systemd container factory successfully Jul 09 16:03:43.340699 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.340684 2581 factory.go:153] Registering CRI-O factory Jul 09 16:03:43.340743 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.340702 2581 factory.go:223] Registration of the crio container factory successfully Jul 09 16:03:43.340787 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.340743 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 16:03:43.340787 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.340764 2581 factory.go:103] Registering Raw factory Jul 09 16:03:43.340787 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.340778 2581 manager.go:1196] Started watching for new ooms in manager Jul 09 16:03:43.341909 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.341890 2581 manager.go:349] Starting recovery of all containers Jul 09 16:03:43.354064 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.353897 2581 manager.go:354] Recovery completed Jul 09 16:03:43.355389 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.355367 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 16:03:43.355460 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.355409 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 16:03:43.358453 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.358441 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:03:43.360433 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.360412 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:03:43.360543 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.360443 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:03:43.360543 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.360455 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:03:43.361073 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.361054 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 16:03:43.361073 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.361072 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 16:03:43.361178 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.361081 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:03:43.361178 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.361089 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 09 16:03:43.361772 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.361758 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:03:43.361837 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.361788 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:03:43.361837 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.361804 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:03:43.362300 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.362288 2581 policy_none.go:49] "None policy: Start" Jul 09 16:03:43.362338 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.362304 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 16:03:43.362338 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.362316 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 16:03:43.363296 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.363285 2581 policy_none.go:47] "Start" Jul 09 16:03:43.374362 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.374278 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18c0aa984228b466 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-07-09 16:03:43.360431206 +0000 UTC m=+0.432027154,LastTimestamp:2026-07-09 16:03:43.360431206 +0000 UTC m=+0.432027154,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}" Jul 09 16:03:43.391113 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.391047 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18c0aa984228f82b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-0.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-07-09 16:03:43.360448555 +0000 UTC m=+0.432044499,LastTimestamp:2026-07-09 16:03:43.360448555 +0000 UTC m=+0.432044499,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}" Jul 09 16:03:43.395114 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.395099 2581 manager.go:337] "Starting Device Plugin manager" Jul 09 16:03:43.419891 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.395135 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 16:03:43.419891 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.395149 2581 server.go:87] "Starting device plugin registration server" Jul 09 16:03:43.419891 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.395359 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 16:03:43.419891 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.395369 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 16:03:43.419891 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.395511 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 16:03:43.419891 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.395610 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 16:03:43.419891 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.395620 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 16:03:43.419891 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.396104 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 16:03:43.419891 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.396160 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:43.419891 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.401240 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18c0aa9842291f7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-0.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-07-09 16:03:43.360458623 +0000 UTC m=+0.432054564,LastTimestamp:2026-07-09 16:03:43.360458623 +0000 UTC m=+0.432054564,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}" Jul 09 16:03:43.419891 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.414103 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-0.ec2.internal.18c0aa984228b466\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18c0aa984228b466 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-07-09 16:03:43.360431206 +0000 UTC m=+0.432027154,LastTimestamp:2026-07-09 16:03:43.361772991 +0000 UTC m=+0.433368931,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}" Jul 09 16:03:43.428314 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.428244 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-0.ec2.internal.18c0aa984228f82b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18c0aa984228f82b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-0.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-07-09 16:03:43.360448555 +0000 UTC m=+0.432044499,LastTimestamp:2026-07-09 16:03:43.361794979 +0000 UTC m=+0.433390921,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}" Jul 09 16:03:43.438587 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.438521 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-0.ec2.internal.18c0aa9842291f7f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18c0aa9842291f7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-0.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-07-09 16:03:43.360458623 +0000 UTC m=+0.432054564,LastTimestamp:2026-07-09 16:03:43.361810017 +0000 UTC m=+0.433405959,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}" Jul 09 16:03:43.448963 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.448899 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18c0aa98445cbd65 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-07-09 16:03:43.397395813 +0000 UTC m=+0.468991755,LastTimestamp:2026-07-09 16:03:43.397395813 +0000 UTC m=+0.468991755,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}" Jul 09 16:03:43.457669 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.457648 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9gsqw" Jul 09 16:03:43.476738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.476720 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9gsqw" Jul 09 16:03:43.495873 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.495828 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:03:43.496853 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.496838 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:03:43.496911 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.496867 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:03:43.496911 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.496876 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:03:43.496911 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.496900 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.503298 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.503274 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 16:03:43.504600 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.504587 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 16:03:43.504663 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.504621 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 16:03:43.504663 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.504641 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 16:03:43.504733 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.504671 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 16:03:43.513397 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.513376 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:03:43.528117 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.528101 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.528191 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.528123 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-0.ec2.internal\": node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:43.605393 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.605355 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal"] Jul 09 16:03:43.605560 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.605433 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:03:43.606325 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.606311 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:03:43.606384 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.606339 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:03:43.606384 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.606349 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:03:43.608614 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.608601 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:03:43.608723 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.608705 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.608831 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.608738 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:03:43.609341 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.609325 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:03:43.609404 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.609358 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:03:43.609404 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.609366 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:03:43.609404 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.609372 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:03:43.609529 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.609390 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:03:43.609529 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.609457 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:03:43.611621 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.611599 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.611716 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.611631 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:03:43.612259 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.612244 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:03:43.612333 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.612268 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:03:43.612333 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.612279 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:03:43.614373 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.614356 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:43.634050 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.634026 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-0.ec2.internal\" not found" node="ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.638295 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.638280 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-0.ec2.internal\" not found" node="ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.641487 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.641454 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/706dc0ba20d5b2176781c9e08f11c9d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"706dc0ba20d5b2176781c9e08f11c9d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.641557 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.641503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28e4344559374a09481bb16f35bd05f6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-0.ec2.internal\" (UID: \"28e4344559374a09481bb16f35bd05f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.641557 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.641524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/706dc0ba20d5b2176781c9e08f11c9d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"706dc0ba20d5b2176781c9e08f11c9d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.715356 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.715322 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:43.741780 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.741744 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28e4344559374a09481bb16f35bd05f6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-0.ec2.internal\" (UID: \"28e4344559374a09481bb16f35bd05f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.742186 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.741659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28e4344559374a09481bb16f35bd05f6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-0.ec2.internal\" (UID: \"28e4344559374a09481bb16f35bd05f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.742186 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.742070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/706dc0ba20d5b2176781c9e08f11c9d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"706dc0ba20d5b2176781c9e08f11c9d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.742186 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.742140 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/706dc0ba20d5b2176781c9e08f11c9d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"706dc0ba20d5b2176781c9e08f11c9d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.742323 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.742221 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/706dc0ba20d5b2176781c9e08f11c9d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"706dc0ba20d5b2176781c9e08f11c9d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.742323 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.742273 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/706dc0ba20d5b2176781c9e08f11c9d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"706dc0ba20d5b2176781c9e08f11c9d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.816106 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.816015 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:43.916193 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:43.916151 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:43.936346 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.936319 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 09 16:03:43.941450 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:43.941177 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 09 16:03:44.016793 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:44.016759 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:44.117483 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:44.117394 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:44.218064 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:44.218019 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:44.269715 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.269682 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 16:03:44.270284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.269838 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 16:03:44.318262 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:44.318222 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:44.419310 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:44.419235 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:44.485830 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.485766 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 15:58:43 +0000 UTC" deadline="2028-01-30 16:18:36.111241271 +0000 UTC" Jul 09 16:03:44.485830 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.485821 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13680h14m51.625423284s" Jul 09 16:03:44.486884 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.486865 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:03:44.487898 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.487884 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:03:44.487958 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.487913 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:03:44.487958 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.487926 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:03:44.519842 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:44.519814 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:44.620501 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:44.620456 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:44.721191 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:44.721123 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found" Jul 09 16:03:44.742419 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.742387 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:03:44.759564 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:44.759528 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e4344559374a09481bb16f35bd05f6.slice/crio-b420b9f747f2a64902169d1ec7ac350355c1dae6e37e33165a2f376bd58b9d35 WatchSource:0}: Error finding container b420b9f747f2a64902169d1ec7ac350355c1dae6e37e33165a2f376bd58b9d35: Status 404 returned error can't find the container with id b420b9f747f2a64902169d1ec7ac350355c1dae6e37e33165a2f376bd58b9d35 Jul 09 16:03:44.764356 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.764339 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:03:44.825962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.825930 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:03:44.838360 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.838339 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" Jul 09 16:03:44.856477 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.856442 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 16:03:44.857174 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.857162 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" Jul 09 16:03:44.871316 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.871294 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 16:03:44.891585 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:44.891563 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:03:45.316137 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.316037 2581 apiserver.go:52] "Watching apiserver" Jul 09 16:03:45.324613 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:45.324583 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706dc0ba20d5b2176781c9e08f11c9d5.slice/crio-052f95de906b61abd8792765568173dcee9fb337bee0c5e7e654e0693e9556a0 WatchSource:0}: Error finding container 052f95de906b61abd8792765568173dcee9fb337bee0c5e7e654e0693e9556a0: Status 404 returned error can't find the container with id 052f95de906b61abd8792765568173dcee9fb337bee0c5e7e654e0693e9556a0 Jul 09 16:03:45.327053 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.327023 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 16:03:45.327484 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.327457 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-hn2fx","openshift-multus/multus-additional-cni-plugins-xb65r","openshift-multus/multus-z95sg","openshift-network-operator/iptables-alerter-hxl8f","openshift-ovn-kubernetes/ovnkube-node-dbvp4","kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx","openshift-cluster-node-tuning-operator/tuned-vb7qf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal","openshift-multus/network-metrics-daemon-k74h8","openshift-network-diagnostics/network-check-target-vv4cv","kube-system/global-pull-secret-syncer-fvv7c","kube-system/konnectivity-agent-p8lkl","openshift-dns/node-resolver-8nqhq"] Jul 09 16:03:45.330337 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.330317 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:45.330412 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.330391 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:03:45.332668 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.332648 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.334798 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.334779 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxl8f" Jul 09 16:03:45.337048 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.337029 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hn2fx" Jul 09 16:03:45.339014 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.338990 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 16:03:45.339142 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.339051 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 16:03:45.339231 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.339198 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 16:03:45.339406 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.339388 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 16:03:45.339529 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.339435 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hk58h\"" Jul 09 16:03:45.339529 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.339448 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 16:03:45.340475 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.340084 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 16:03:45.340754 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.340736 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.343188 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.343167 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.345642 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.345622 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.346170 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.346151 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 16:03:45.346262 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.346212 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 16:03:45.346322 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.346296 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 16:03:45.346379 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.346365 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 16:03:45.346607 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.346590 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 16:03:45.347831 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.347809 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:03:45.347979 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.347840 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 16:03:45.347979 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.347860 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 16:03:45.348284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.347988 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 16:03:45.348284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.348022 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 16:03:45.348284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.348059 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 16:03:45.348284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.348067 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mxkhb\"" Jul 09 16:03:45.348284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.348143 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4lq4q\"" Jul 09 16:03:45.348284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.348149 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rpr69\"" Jul 09 16:03:45.348284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.348191 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 16:03:45.348284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.348241 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t6nv2\"" Jul 09 16:03:45.348683 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.348539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.351139 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.351120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:45.351222 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.351196 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:03:45.351924 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.351907 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 16:03:45.352755 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.352736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-run-netns\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.352818 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.352763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-run-systemd\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.352818 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.352780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-etc-openvswitch\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.352818 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.352797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-run-ovn-kubernetes\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.352818 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.352815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f91294fb-ac44-48d8-a7b2-fbb8941bbce9-host\") pod \"node-ca-hn2fx\" (UID: \"f91294fb-ac44-48d8-a7b2-fbb8941bbce9\") " pod="openshift-image-registry/node-ca-hn2fx" Jul 09 16:03:45.353024 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.352861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-kubelet\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353024 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.352899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-log-socket\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353024 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.352930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/244c6150-ca46-4324-9b34-b5e812e5dd40-env-overrides\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353024 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.352958 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/244c6150-ca46-4324-9b34-b5e812e5dd40-ovn-node-metrics-cert\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353024 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.352987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/244c6150-ca46-4324-9b34-b5e812e5dd40-ovnkube-script-lib\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353024 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z7s8\" (UniqueName: \"kubernetes.io/projected/865c284a-ea51-4053-9d3e-32524736479b-kube-api-access-5z7s8\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:45.353271 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.353271 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12db79fe-1de5-4e03-9baf-a54794d69eaa-host-slash\") pod \"iptables-alerter-hxl8f\" (UID: \"12db79fe-1de5-4e03-9baf-a54794d69eaa\") " pod="openshift-network-operator/iptables-alerter-hxl8f" Jul 09 16:03:45.353271 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-slash\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353271 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-cnibin\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.353271 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.353271 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353192 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-run-ovn\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353271 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:45.353271 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc88f\" (UniqueName: \"kubernetes.io/projected/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-kube-api-access-bc88f\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.353605 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12db79fe-1de5-4e03-9baf-a54794d69eaa-iptables-alerter-script\") pod \"iptables-alerter-hxl8f\" (UID: \"12db79fe-1de5-4e03-9baf-a54794d69eaa\") " pod="openshift-network-operator/iptables-alerter-hxl8f" Jul 09 16:03:45.353605 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-var-lib-openvswitch\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353605 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-node-log\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353605 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-cni-bin\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353605 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.353605 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-run-openvswitch\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353605 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353530 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/244c6150-ca46-4324-9b34-b5e812e5dd40-ovnkube-config\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353605 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dm7m\" (UniqueName: \"kubernetes.io/projected/12db79fe-1de5-4e03-9baf-a54794d69eaa-kube-api-access-9dm7m\") pod \"iptables-alerter-hxl8f\" (UID: \"12db79fe-1de5-4e03-9baf-a54794d69eaa\") " pod="openshift-network-operator/iptables-alerter-hxl8f" Jul 09 16:03:45.353605 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353577 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f91294fb-ac44-48d8-a7b2-fbb8941bbce9-serviceca\") pod \"node-ca-hn2fx\" (UID: \"f91294fb-ac44-48d8-a7b2-fbb8941bbce9\") " pod="openshift-image-registry/node-ca-hn2fx" Jul 09 16:03:45.353945 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx9f5\" (UniqueName: \"kubernetes.io/projected/f91294fb-ac44-48d8-a7b2-fbb8941bbce9-kube-api-access-zx9f5\") pod \"node-ca-hn2fx\" (UID: \"f91294fb-ac44-48d8-a7b2-fbb8941bbce9\") " pod="openshift-image-registry/node-ca-hn2fx" Jul 09 16:03:45.353945 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-systemd-units\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353945 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msdbd\" (UniqueName: \"kubernetes.io/projected/244c6150-ca46-4324-9b34-b5e812e5dd40-kube-api-access-msdbd\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353945 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-system-cni-dir\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.353945 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353721 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-os-release\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.353945 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353747 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.353945 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353758 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:45.353945 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-cni-netd\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353945 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.353801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.353945 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.353833 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:03:45.356132 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.356113 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:03:45.358011 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.357989 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:03:45.358106 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.358061 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vndj7\"" Jul 09 16:03:45.358199 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.358180 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 16:03:45.358340 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.358314 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wtrck\"" Jul 09 16:03:45.358559 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.358544 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8nqhq" Jul 09 16:03:45.359862 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.359845 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 16:03:45.360108 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.360088 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jzws2\"" Jul 09 16:03:45.360169 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.360115 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 16:03:45.364641 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.364606 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 16:03:45.364756 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.364667 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 16:03:45.364756 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.364673 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 16:03:45.364756 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.364690 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 16:03:45.364756 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.364737 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-85ldd\"" Jul 09 16:03:45.364954 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.364769 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 16:03:45.368563 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.368543 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 16:03:45.441279 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.441253 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 16:03:45.441450 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.441433 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lcbmc" Jul 09 16:03:45.454135 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-run-multus-certs\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.454202 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eef619ed-c5fa-4806-ba7f-c1799b636cc0-tmp-dir\") pod \"node-resolver-8nqhq\" (UID: \"eef619ed-c5fa-4806-ba7f-c1799b636cc0\") " pod="openshift-dns/node-resolver-8nqhq" Jul 09 16:03:45.454202 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-cnibin\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.454202 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.454311 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqm5q\" (UniqueName: \"kubernetes.io/projected/05b64064-68ff-4a52-b45b-29868161089d-kube-api-access-vqm5q\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.454311 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454237 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-cnibin\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.454311 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97458a95-03a2-4b60-aeef-a34cc99f2218-konnectivity-ca\") pod \"konnectivity-agent-p8lkl\" (UID: \"97458a95-03a2-4b60-aeef-a34cc99f2218\") " pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:03:45.454311 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-lib-modules\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.454311 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-node-log\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.454489 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454314 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-cni-bin\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.454489 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzr9n\" (UniqueName: \"kubernetes.io/projected/e4d18ef1-a307-414c-bdad-c0df35ac836c-kube-api-access-wzr9n\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.454489 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454347 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-var-lib-cni-multus\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.454489 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.454489 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-run-openvswitch\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.454489 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-node-log\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.454489 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454418 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-cni-bin\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.454489 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454442 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-run-openvswitch\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.454489 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/244c6150-ca46-4324-9b34-b5e812e5dd40-ovnkube-config\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-var-lib-cni-bin\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dm7m\" (UniqueName: \"kubernetes.io/projected/12db79fe-1de5-4e03-9baf-a54794d69eaa-kube-api-access-9dm7m\") pod \"iptables-alerter-hxl8f\" (UID: \"12db79fe-1de5-4e03-9baf-a54794d69eaa\") " pod="openshift-network-operator/iptables-alerter-hxl8f" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-systemd\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-os-release\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-system-cni-dir\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-etc-selinux\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454791 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-system-cni-dir\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2c76\" (UniqueName: \"kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76\") pod \"network-check-target-vv4cv\" (UID: \"aa412a52-1e4c-44b6-997f-0c1bafe85fd7\") " pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454807 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-tuned\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lwlv\" (UniqueName: \"kubernetes.io/projected/eef619ed-c5fa-4806-ba7f-c1799b636cc0-kube-api-access-8lwlv\") pod \"node-resolver-8nqhq\" (UID: \"eef619ed-c5fa-4806-ba7f-c1799b636cc0\") " pod="openshift-dns/node-resolver-8nqhq" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454917 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-run-systemd\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.454962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454959 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454980 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-run-systemd\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-etc-openvswitch\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.454997 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/244c6150-ca46-4324-9b34-b5e812e5dd40-ovnkube-config\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-run-ovn-kubernetes\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-sys\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-cni-dir\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-hostroot\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f91294fb-ac44-48d8-a7b2-fbb8941bbce9-host\") pod \"node-ca-hn2fx\" (UID: \"f91294fb-ac44-48d8-a7b2-fbb8941bbce9\") " pod="openshift-image-registry/node-ca-hn2fx" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455098 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-run-ovn-kubernetes\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455107 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-etc-openvswitch\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455141 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-kubelet\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455157 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f91294fb-ac44-48d8-a7b2-fbb8941bbce9-host\") pod \"node-ca-hn2fx\" (UID: \"f91294fb-ac44-48d8-a7b2-fbb8941bbce9\") " pod="openshift-image-registry/node-ca-hn2fx" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/244c6150-ca46-4324-9b34-b5e812e5dd40-env-overrides\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/244c6150-ca46-4324-9b34-b5e812e5dd40-ovn-node-metrics-cert\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z7s8\" (UniqueName: \"kubernetes.io/projected/865c284a-ea51-4053-9d3e-32524736479b-kube-api-access-5z7s8\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455264 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-socket-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.455667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455246 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-kubelet\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-registration-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-run\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-modprobe-d\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455493 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-sysctl-d\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-run-ovn\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455541 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/244c6150-ca46-4324-9b34-b5e812e5dd40-env-overrides\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455560 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-run-ovn\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455610 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-host\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455686 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-run-k8s-cni-cncf-io\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.455698 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455710 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-run-netns\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc88f\" (UniqueName: \"kubernetes.io/projected/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-kube-api-access-bc88f\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.455766 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs podName:865c284a-ea51-4053-9d3e-32524736479b nodeName:}" failed. No retries permitted until 2026-07-09 16:03:45.955741109 +0000 UTC m=+3.027337040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs") pod "network-metrics-daemon-k74h8" (UID: "865c284a-ea51-4053-9d3e-32524736479b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:03:45.456476 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12db79fe-1de5-4e03-9baf-a54794d69eaa-iptables-alerter-script\") pod \"iptables-alerter-hxl8f\" (UID: \"12db79fe-1de5-4e03-9baf-a54794d69eaa\") " pod="openshift-network-operator/iptables-alerter-hxl8f" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-var-lib-openvswitch\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-var-lib-kubelet\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-conf-dir\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455946 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-var-lib-openvswitch\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-socket-dir-parent\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.455993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-etc-kubernetes\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f91294fb-ac44-48d8-a7b2-fbb8941bbce9-serviceca\") pod \"node-ca-hn2fx\" (UID: \"f91294fb-ac44-48d8-a7b2-fbb8941bbce9\") " pod="openshift-image-registry/node-ca-hn2fx" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx9f5\" (UniqueName: \"kubernetes.io/projected/f91294fb-ac44-48d8-a7b2-fbb8941bbce9-kube-api-access-zx9f5\") pod \"node-ca-hn2fx\" (UID: \"f91294fb-ac44-48d8-a7b2-fbb8941bbce9\") " pod="openshift-image-registry/node-ca-hn2fx" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456069 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-systemd-units\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msdbd\" (UniqueName: \"kubernetes.io/projected/244c6150-ca46-4324-9b34-b5e812e5dd40-kube-api-access-msdbd\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-sysconfig\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-kubernetes\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456139 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-systemd-units\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456166 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzqm2\" (UniqueName: \"kubernetes.io/projected/4ab0b329-22ff-4c9f-b350-73462deaae48-kube-api-access-vzqm2\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eef619ed-c5fa-4806-ba7f-c1799b636cc0-hosts-file\") pod \"node-resolver-8nqhq\" (UID: \"eef619ed-c5fa-4806-ba7f-c1799b636cc0\") " pod="openshift-dns/node-resolver-8nqhq" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-os-release\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.457212 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-cni-netd\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-device-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456317 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12db79fe-1de5-4e03-9baf-a54794d69eaa-iptables-alerter-script\") pod \"iptables-alerter-hxl8f\" (UID: \"12db79fe-1de5-4e03-9baf-a54794d69eaa\") " pod="openshift-network-operator/iptables-alerter-hxl8f" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456317 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-os-release\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456356 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-cni-netd\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-daemon-config\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-run-netns\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf5a02de-1a51-4524-a37a-4be5b379712c-kubelet-config\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97458a95-03a2-4b60-aeef-a34cc99f2218-agent-certs\") pod \"konnectivity-agent-p8lkl\" (UID: \"97458a95-03a2-4b60-aeef-a34cc99f2218\") " pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456516 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-run-netns\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-sysctl-conf\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456587 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f91294fb-ac44-48d8-a7b2-fbb8941bbce9-serviceca\") pod \"node-ca-hn2fx\" (UID: \"f91294fb-ac44-48d8-a7b2-fbb8941bbce9\") " pod="openshift-image-registry/node-ca-hn2fx" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-log-socket\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456746 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/244c6150-ca46-4324-9b34-b5e812e5dd40-ovnkube-script-lib\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-sys-fs\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.457738 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456791 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-log-socket\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf5a02de-1a51-4524-a37a-4be5b379712c-dbus\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-var-lib-kubelet\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4d18ef1-a307-414c-bdad-c0df35ac836c-tmp\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-system-cni-dir\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-cnibin\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12db79fe-1de5-4e03-9baf-a54794d69eaa-host-slash\") pod \"iptables-alerter-hxl8f\" (UID: \"12db79fe-1de5-4e03-9baf-a54794d69eaa\") " pod="openshift-network-operator/iptables-alerter-hxl8f" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456959 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-slash\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.456982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ab0b329-22ff-4c9f-b350-73462deaae48-cni-binary-copy\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.457015 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12db79fe-1de5-4e03-9baf-a54794d69eaa-host-slash\") pod \"iptables-alerter-hxl8f\" (UID: \"12db79fe-1de5-4e03-9baf-a54794d69eaa\") " pod="openshift-network-operator/iptables-alerter-hxl8f" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.457024 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/244c6150-ca46-4324-9b34-b5e812e5dd40-host-slash\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.457113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.458244 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.457169 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/244c6150-ca46-4324-9b34-b5e812e5dd40-ovnkube-script-lib\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.458973 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.458954 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/244c6150-ca46-4324-9b34-b5e812e5dd40-ovn-node-metrics-cert\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.460722 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.460707 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lcbmc" Jul 09 16:03:45.477291 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.477265 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx9f5\" (UniqueName: \"kubernetes.io/projected/f91294fb-ac44-48d8-a7b2-fbb8941bbce9-kube-api-access-zx9f5\") pod \"node-ca-hn2fx\" (UID: \"f91294fb-ac44-48d8-a7b2-fbb8941bbce9\") " pod="openshift-image-registry/node-ca-hn2fx" Jul 09 16:03:45.487478 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.487435 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc88f\" (UniqueName: \"kubernetes.io/projected/8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca-kube-api-access-bc88f\") pod \"multus-additional-cni-plugins-xb65r\" (UID: \"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca\") " pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.487586 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.487541 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dm7m\" (UniqueName: \"kubernetes.io/projected/12db79fe-1de5-4e03-9baf-a54794d69eaa-kube-api-access-9dm7m\") pod \"iptables-alerter-hxl8f\" (UID: \"12db79fe-1de5-4e03-9baf-a54794d69eaa\") " pod="openshift-network-operator/iptables-alerter-hxl8f" Jul 09 16:03:45.488654 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.488637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z7s8\" (UniqueName: \"kubernetes.io/projected/865c284a-ea51-4053-9d3e-32524736479b-kube-api-access-5z7s8\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:45.489043 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.489026 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msdbd\" (UniqueName: \"kubernetes.io/projected/244c6150-ca46-4324-9b34-b5e812e5dd40-kube-api-access-msdbd\") pod \"ovnkube-node-dbvp4\" (UID: \"244c6150-ca46-4324-9b34-b5e812e5dd40\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.511668 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.511616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" event={"ID":"706dc0ba20d5b2176781c9e08f11c9d5","Type":"ContainerStarted","Data":"052f95de906b61abd8792765568173dcee9fb337bee0c5e7e654e0693e9556a0"} Jul 09 16:03:45.512679 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.512659 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" event={"ID":"28e4344559374a09481bb16f35bd05f6","Type":"ContainerStarted","Data":"b420b9f747f2a64902169d1ec7ac350355c1dae6e37e33165a2f376bd58b9d35"} Jul 09 16:03:45.557647 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-device-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.557647 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-daemon-config\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.557847 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557667 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf5a02de-1a51-4524-a37a-4be5b379712c-kubelet-config\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:45.557847 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97458a95-03a2-4b60-aeef-a34cc99f2218-agent-certs\") pod \"konnectivity-agent-p8lkl\" (UID: \"97458a95-03a2-4b60-aeef-a34cc99f2218\") " pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:03:45.557847 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-sysctl-conf\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.557847 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-sys-fs\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.557847 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557771 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf5a02de-1a51-4524-a37a-4be5b379712c-kubelet-config\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:45.557847 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557775 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-device-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.557847 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557815 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-sys-fs\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.557847 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf5a02de-1a51-4524-a37a-4be5b379712c-dbus\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-var-lib-kubelet\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557901 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-sysctl-conf\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4d18ef1-a307-414c-bdad-c0df35ac836c-tmp\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557952 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-var-lib-kubelet\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-system-cni-dir\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf5a02de-1a51-4524-a37a-4be5b379712c-dbus\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.557985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-cnibin\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558000 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-system-cni-dir\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558007 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ab0b329-22ff-4c9f-b350-73462deaae48-cni-binary-copy\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-run-multus-certs\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eef619ed-c5fa-4806-ba7f-c1799b636cc0-tmp-dir\") pod \"node-resolver-8nqhq\" (UID: \"eef619ed-c5fa-4806-ba7f-c1799b636cc0\") " pod="openshift-dns/node-resolver-8nqhq" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558087 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-cnibin\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm5q\" (UniqueName: \"kubernetes.io/projected/05b64064-68ff-4a52-b45b-29868161089d-kube-api-access-vqm5q\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558155 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-run-multus-certs\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558234 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558206 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97458a95-03a2-4b60-aeef-a34cc99f2218-konnectivity-ca\") pod \"konnectivity-agent-p8lkl\" (UID: \"97458a95-03a2-4b60-aeef-a34cc99f2218\") " pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558323 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-daemon-config\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-lib-modules\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558378 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eef619ed-c5fa-4806-ba7f-c1799b636cc0-tmp-dir\") pod \"node-resolver-8nqhq\" (UID: \"eef619ed-c5fa-4806-ba7f-c1799b636cc0\") " pod="openshift-dns/node-resolver-8nqhq" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr9n\" (UniqueName: \"kubernetes.io/projected/e4d18ef1-a307-414c-bdad-c0df35ac836c-kube-api-access-wzr9n\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558426 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-var-lib-cni-multus\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558450 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-lib-modules\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-var-lib-cni-bin\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-systemd\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558533 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-var-lib-cni-multus\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558573 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ab0b329-22ff-4c9f-b350-73462deaae48-cni-binary-copy\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558590 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-var-lib-cni-bin\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558641 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-systemd\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-os-release\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558679 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-os-release\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-etc-selinux\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558791 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.558968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2c76\" (UniqueName: \"kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76\") pod \"network-check-target-vv4cv\" (UID: \"aa412a52-1e4c-44b6-997f-0c1bafe85fd7\") " pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-tuned\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558842 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97458a95-03a2-4b60-aeef-a34cc99f2218-konnectivity-ca\") pod \"konnectivity-agent-p8lkl\" (UID: \"97458a95-03a2-4b60-aeef-a34cc99f2218\") " pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lwlv\" (UniqueName: \"kubernetes.io/projected/eef619ed-c5fa-4806-ba7f-c1799b636cc0-kube-api-access-8lwlv\") pod \"node-resolver-8nqhq\" (UID: \"eef619ed-c5fa-4806-ba7f-c1799b636cc0\") " pod="openshift-dns/node-resolver-8nqhq" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558874 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-etc-selinux\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-sys\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-cni-dir\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-hostroot\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.558988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-socket-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559006 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-sys\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-registration-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559026 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-cni-dir\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-run\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559050 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-hostroot\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-modprobe-d\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559098 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-registration-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559100 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-sysctl-d\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559127 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05b64064-68ff-4a52-b45b-29868161089d-socket-dir\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.560134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559148 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-run\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-host\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-run-k8s-cni-cncf-io\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559203 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-modprobe-d\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-run-netns\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.559231 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559243 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-host\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559247 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-run-k8s-cni-cncf-io\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-var-lib-kubelet\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559267 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-sysctl-d\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559284 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-run-netns\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.559288 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret podName:cf5a02de-1a51-4524-a37a-4be5b379712c nodeName:}" failed. No retries permitted until 2026-07-09 16:03:46.059270093 +0000 UTC m=+3.130866022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret") pod "global-pull-secret-syncer-fvv7c" (UID: "cf5a02de-1a51-4524-a37a-4be5b379712c") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559300 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-host-var-lib-kubelet\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-conf-dir\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559339 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-conf-dir\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559338 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-socket-dir-parent\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-etc-kubernetes\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561015 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-sysconfig\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.561613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-kubernetes\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.561613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzqm2\" (UniqueName: \"kubernetes.io/projected/4ab0b329-22ff-4c9f-b350-73462deaae48-kube-api-access-vzqm2\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559484 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-etc-kubernetes\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559492 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ab0b329-22ff-4c9f-b350-73462deaae48-multus-socket-dir-parent\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.561613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559514 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-sysconfig\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.561613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eef619ed-c5fa-4806-ba7f-c1799b636cc0-hosts-file\") pod \"node-resolver-8nqhq\" (UID: \"eef619ed-c5fa-4806-ba7f-c1799b636cc0\") " pod="openshift-dns/node-resolver-8nqhq" Jul 09 16:03:45.561613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559554 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-kubernetes\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.561613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.559633 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eef619ed-c5fa-4806-ba7f-c1799b636cc0-hosts-file\") pod \"node-resolver-8nqhq\" (UID: \"eef619ed-c5fa-4806-ba7f-c1799b636cc0\") " pod="openshift-dns/node-resolver-8nqhq" Jul 09 16:03:45.561613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.560887 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4d18ef1-a307-414c-bdad-c0df35ac836c-tmp\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.561613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.561189 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97458a95-03a2-4b60-aeef-a34cc99f2218-agent-certs\") pod \"konnectivity-agent-p8lkl\" (UID: \"97458a95-03a2-4b60-aeef-a34cc99f2218\") " pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:03:45.561613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.561380 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e4d18ef1-a307-414c-bdad-c0df35ac836c-etc-tuned\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.574630 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.574578 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqm5q\" (UniqueName: \"kubernetes.io/projected/05b64064-68ff-4a52-b45b-29868161089d-kube-api-access-vqm5q\") pod \"aws-ebs-csi-driver-node-kl8wx\" (UID: \"05b64064-68ff-4a52-b45b-29868161089d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.576299 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.576283 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzr9n\" (UniqueName: \"kubernetes.io/projected/e4d18ef1-a307-414c-bdad-c0df35ac836c-kube-api-access-wzr9n\") pod \"tuned-vb7qf\" (UID: \"e4d18ef1-a307-414c-bdad-c0df35ac836c\") " pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.576883 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.576842 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:03:45.576883 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.576873 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:03:45.577177 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.576890 2581 projected.go:196] Error preparing data for projected volume kube-api-access-l2c76 for pod openshift-network-diagnostics/network-check-target-vv4cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:03:45.577177 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.576971 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76 podName:aa412a52-1e4c-44b6-997f-0c1bafe85fd7 nodeName:}" failed. No retries permitted until 2026-07-09 16:03:46.076952927 +0000 UTC m=+3.148548859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l2c76" (UniqueName: "kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76") pod "network-check-target-vv4cv" (UID: "aa412a52-1e4c-44b6-997f-0c1bafe85fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:03:45.579282 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.579233 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lwlv\" (UniqueName: \"kubernetes.io/projected/eef619ed-c5fa-4806-ba7f-c1799b636cc0-kube-api-access-8lwlv\") pod \"node-resolver-8nqhq\" (UID: \"eef619ed-c5fa-4806-ba7f-c1799b636cc0\") " pod="openshift-dns/node-resolver-8nqhq" Jul 09 16:03:45.579509 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.579490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzqm2\" (UniqueName: \"kubernetes.io/projected/4ab0b329-22ff-4c9f-b350-73462deaae48-kube-api-access-vzqm2\") pod \"multus-z95sg\" (UID: \"4ab0b329-22ff-4c9f-b350-73462deaae48\") " pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.645055 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.644986 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xb65r" Jul 09 16:03:45.651433 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.651408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxl8f" Jul 09 16:03:45.656869 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:45.656837 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5ec4f5_3080_4fd6_a6d3_9ec460b706ca.slice/crio-7f252354731bfa26f6559546b6b6bc69fa9dab1e439f8fc9bb179120194408dd WatchSource:0}: Error finding container 7f252354731bfa26f6559546b6b6bc69fa9dab1e439f8fc9bb179120194408dd: Status 404 returned error can't find the container with id 7f252354731bfa26f6559546b6b6bc69fa9dab1e439f8fc9bb179120194408dd Jul 09 16:03:45.659491 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.659410 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hn2fx" Jul 09 16:03:45.663634 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.663094 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:03:45.669751 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.669526 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" Jul 09 16:03:45.675865 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.675840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" Jul 09 16:03:45.681486 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.681418 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z95sg" Jul 09 16:03:45.688671 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.687436 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:03:45.688671 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:45.687936 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b64064_68ff_4a52_b45b_29868161089d.slice/crio-ae423c07115ec8ff8d5dad47fdbfa319e8cf900d77f5cd33883d9f3b6a23608a WatchSource:0}: Error finding container ae423c07115ec8ff8d5dad47fdbfa319e8cf900d77f5cd33883d9f3b6a23608a: Status 404 returned error can't find the container with id ae423c07115ec8ff8d5dad47fdbfa319e8cf900d77f5cd33883d9f3b6a23608a Jul 09 16:03:45.691462 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.691445 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8nqhq" Jul 09 16:03:45.692065 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:45.692033 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d18ef1_a307_414c_bdad_c0df35ac836c.slice/crio-d8e92e6a6f01b573c4164b473c1cd9a73605e51608742074dce28587cc14724e WatchSource:0}: Error finding container d8e92e6a6f01b573c4164b473c1cd9a73605e51608742074dce28587cc14724e: Status 404 returned error can't find the container with id d8e92e6a6f01b573c4164b473c1cd9a73605e51608742074dce28587cc14724e Jul 09 16:03:45.705622 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:45.705591 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab0b329_22ff_4c9f_b350_73462deaae48.slice/crio-16a4433d1aec8cbbab829e483866367e6e7c17186831432266025bbb707ceaa0 WatchSource:0}: Error finding container 16a4433d1aec8cbbab829e483866367e6e7c17186831432266025bbb707ceaa0: Status 404 returned error can't find the container with id 16a4433d1aec8cbbab829e483866367e6e7c17186831432266025bbb707ceaa0 Jul 09 16:03:45.711384 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:03:45.711360 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97458a95_03a2_4b60_aeef_a34cc99f2218.slice/crio-0b288f7407ed0b8312745f867561b341389627694c616dee53fe273e12dead4a WatchSource:0}: Error finding container 0b288f7407ed0b8312745f867561b341389627694c616dee53fe273e12dead4a: Status 404 returned error can't find the container with id 0b288f7407ed0b8312745f867561b341389627694c616dee53fe273e12dead4a Jul 09 16:03:45.778701 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.778668 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:03:45.961528 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:45.961425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:45.961679 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.961627 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:03:45.961729 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:45.961694 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs podName:865c284a-ea51-4053-9d3e-32524736479b nodeName:}" failed. No retries permitted until 2026-07-09 16:03:46.96167422 +0000 UTC m=+4.033270169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs") pod "network-metrics-daemon-k74h8" (UID: "865c284a-ea51-4053-9d3e-32524736479b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:03:46.062273 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.062232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:46.062433 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:46.062379 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:03:46.062472 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:46.062441 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret podName:cf5a02de-1a51-4524-a37a-4be5b379712c nodeName:}" failed. No retries permitted until 2026-07-09 16:03:47.062423101 +0000 UTC m=+4.134019033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret") pod "global-pull-secret-syncer-fvv7c" (UID: "cf5a02de-1a51-4524-a37a-4be5b379712c") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:03:46.162735 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.162527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2c76\" (UniqueName: \"kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76\") pod \"network-check-target-vv4cv\" (UID: \"aa412a52-1e4c-44b6-997f-0c1bafe85fd7\") " pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:46.162881 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:46.162691 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:03:46.162881 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:46.162823 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:03:46.162881 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:46.162838 2581 projected.go:196] Error preparing data for projected volume kube-api-access-l2c76 for pod openshift-network-diagnostics/network-check-target-vv4cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:03:46.163102 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:46.162940 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76 podName:aa412a52-1e4c-44b6-997f-0c1bafe85fd7 nodeName:}" failed. No retries permitted until 2026-07-09 16:03:47.162916041 +0000 UTC m=+4.234511971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2c76" (UniqueName: "kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76") pod "network-check-target-vv4cv" (UID: "aa412a52-1e4c-44b6-997f-0c1bafe85fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:03:46.465750 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.465700 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:58:45 +0000 UTC" deadline="2028-01-27 08:17:44.796175252 +0000 UTC" Jul 09 16:03:46.465750 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.465742 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13600h13m58.3304377s" Jul 09 16:03:46.515445 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.515400 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p8lkl" event={"ID":"97458a95-03a2-4b60-aeef-a34cc99f2218","Type":"ContainerStarted","Data":"0b288f7407ed0b8312745f867561b341389627694c616dee53fe273e12dead4a"} Jul 09 16:03:46.516574 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.516546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z95sg" event={"ID":"4ab0b329-22ff-4c9f-b350-73462deaae48","Type":"ContainerStarted","Data":"16a4433d1aec8cbbab829e483866367e6e7c17186831432266025bbb707ceaa0"} Jul 09 16:03:46.517715 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.517694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hn2fx" event={"ID":"f91294fb-ac44-48d8-a7b2-fbb8941bbce9","Type":"ContainerStarted","Data":"1c59dcf57f7dd5019e810386dff4faae467f2bd25672c899269cecd14436eff3"} Jul 09 16:03:46.518881 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.518856 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxl8f" event={"ID":"12db79fe-1de5-4e03-9baf-a54794d69eaa","Type":"ContainerStarted","Data":"f2c2281d98687b8caa0fd36476fb55c359bb10035886a02e60db498d2dd0a9d6"} Jul 09 16:03:46.520057 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.520035 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8nqhq" event={"ID":"eef619ed-c5fa-4806-ba7f-c1799b636cc0","Type":"ContainerStarted","Data":"5f56dacad6b5523688d37e3380d632b94f3c358b6026ab1a98d74c87869c40e5"} Jul 09 16:03:46.521198 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.521169 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" event={"ID":"e4d18ef1-a307-414c-bdad-c0df35ac836c","Type":"ContainerStarted","Data":"d8e92e6a6f01b573c4164b473c1cd9a73605e51608742074dce28587cc14724e"} Jul 09 16:03:46.522488 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.522445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" event={"ID":"05b64064-68ff-4a52-b45b-29868161089d","Type":"ContainerStarted","Data":"ae423c07115ec8ff8d5dad47fdbfa319e8cf900d77f5cd33883d9f3b6a23608a"} Jul 09 16:03:46.523682 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.523653 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" event={"ID":"244c6150-ca46-4324-9b34-b5e812e5dd40","Type":"ContainerStarted","Data":"e4b8fb964e0155af7967a8678edf3577b03602e3056770827ddc8f3e81f74232"} Jul 09 16:03:46.524815 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.524797 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xb65r" event={"ID":"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca","Type":"ContainerStarted","Data":"7f252354731bfa26f6559546b6b6bc69fa9dab1e439f8fc9bb179120194408dd"} Jul 09 16:03:46.969354 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:46.969318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:46.969585 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:46.969557 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:03:46.969685 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:46.969633 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs podName:865c284a-ea51-4053-9d3e-32524736479b nodeName:}" failed. No retries permitted until 2026-07-09 16:03:48.969612861 +0000 UTC m=+6.041208797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs") pod "network-metrics-daemon-k74h8" (UID: "865c284a-ea51-4053-9d3e-32524736479b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:03:47.070005 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:47.069957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:47.070196 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:47.070168 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:03:47.070276 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:47.070237 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret podName:cf5a02de-1a51-4524-a37a-4be5b379712c nodeName:}" failed. No retries permitted until 2026-07-09 16:03:49.07021686 +0000 UTC m=+6.141812794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret") pod "global-pull-secret-syncer-fvv7c" (UID: "cf5a02de-1a51-4524-a37a-4be5b379712c") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:03:47.171213 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:47.171121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2c76\" (UniqueName: \"kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76\") pod \"network-check-target-vv4cv\" (UID: \"aa412a52-1e4c-44b6-997f-0c1bafe85fd7\") " pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:47.171394 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:47.171369 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:03:47.171394 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:47.171390 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:03:47.171514 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:47.171404 2581 projected.go:196] Error preparing data for projected volume kube-api-access-l2c76 for pod openshift-network-diagnostics/network-check-target-vv4cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:03:47.171514 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:47.171470 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76 podName:aa412a52-1e4c-44b6-997f-0c1bafe85fd7 nodeName:}" failed. No retries permitted until 2026-07-09 16:03:49.171451305 +0000 UTC m=+6.243047237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2c76" (UniqueName: "kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76") pod "network-check-target-vv4cv" (UID: "aa412a52-1e4c-44b6-997f-0c1bafe85fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:03:47.466773 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:47.466628 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:58:45 +0000 UTC" deadline="2028-01-25 23:55:04.779075482 +0000 UTC" Jul 09 16:03:47.466773 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:47.466678 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13567h51m17.312402423s" Jul 09 16:03:47.506707 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:47.506673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:47.506901 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:47.506808 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:03:47.507252 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:47.507228 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:47.507380 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:47.507356 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:03:47.507586 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:47.507548 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:47.507687 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:47.507658 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:03:47.534013 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:47.533972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" event={"ID":"28e4344559374a09481bb16f35bd05f6","Type":"ContainerStarted","Data":"3ef558f14ec09cea4c4d5613d5bd0bf5c9db75801e0f505afc9819e03a56add5"} Jul 09 16:03:48.986677 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:48.986565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:48.987115 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:48.986728 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:03:48.987115 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:48.986814 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs podName:865c284a-ea51-4053-9d3e-32524736479b nodeName:}" failed. No retries permitted until 2026-07-09 16:03:52.986790104 +0000 UTC m=+10.058386038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs") pod "network-metrics-daemon-k74h8" (UID: "865c284a-ea51-4053-9d3e-32524736479b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:03:49.088164 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:49.088117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:49.088376 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:49.088274 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:03:49.088376 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:49.088344 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret podName:cf5a02de-1a51-4524-a37a-4be5b379712c nodeName:}" failed. No retries permitted until 2026-07-09 16:03:53.088324256 +0000 UTC m=+10.159920209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret") pod "global-pull-secret-syncer-fvv7c" (UID: "cf5a02de-1a51-4524-a37a-4be5b379712c") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:03:49.189081 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:49.189036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2c76\" (UniqueName: \"kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76\") pod \"network-check-target-vv4cv\" (UID: \"aa412a52-1e4c-44b6-997f-0c1bafe85fd7\") " pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:49.189284 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:49.189259 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:03:49.189284 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:49.189281 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:03:49.189411 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:49.189294 2581 projected.go:196] Error preparing data for projected volume kube-api-access-l2c76 for pod openshift-network-diagnostics/network-check-target-vv4cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:03:49.189411 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:49.189356 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76 podName:aa412a52-1e4c-44b6-997f-0c1bafe85fd7 nodeName:}" failed. No retries permitted until 2026-07-09 16:03:53.189336938 +0000 UTC m=+10.260932883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2c76" (UniqueName: "kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76") pod "network-check-target-vv4cv" (UID: "aa412a52-1e4c-44b6-997f-0c1bafe85fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:03:49.508117 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:49.508078 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:49.508307 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:49.508225 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:03:49.508718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:49.508690 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:49.508849 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:49.508814 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:03:49.508918 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:49.508876 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:49.508988 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:49.508953 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:03:51.508653 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:51.508624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:51.509125 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:51.508741 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:03:51.509125 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:51.509059 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:51.509192 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:51.509132 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:03:51.509192 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:51.509180 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:51.509268 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:51.509255 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:03:53.024157 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:53.024117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:53.024908 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:53.024293 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:03:53.024908 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:53.024390 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs podName:865c284a-ea51-4053-9d3e-32524736479b nodeName:}" failed. No retries permitted until 2026-07-09 16:04:01.024366392 +0000 UTC m=+18.095962331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs") pod "network-metrics-daemon-k74h8" (UID: "865c284a-ea51-4053-9d3e-32524736479b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:03:53.124744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:53.124703 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:53.124901 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:53.124862 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:03:53.124969 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:53.124926 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret podName:cf5a02de-1a51-4524-a37a-4be5b379712c nodeName:}" failed. No retries permitted until 2026-07-09 16:04:01.124910502 +0000 UTC m=+18.196506435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret") pod "global-pull-secret-syncer-fvv7c" (UID: "cf5a02de-1a51-4524-a37a-4be5b379712c") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:03:53.225595 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:53.225555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2c76\" (UniqueName: \"kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76\") pod \"network-check-target-vv4cv\" (UID: \"aa412a52-1e4c-44b6-997f-0c1bafe85fd7\") " pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:53.225773 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:53.225756 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:03:53.225831 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:53.225779 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:03:53.225831 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:53.225793 2581 projected.go:196] Error preparing data for projected volume kube-api-access-l2c76 for pod openshift-network-diagnostics/network-check-target-vv4cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:03:53.225945 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:53.225845 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76 podName:aa412a52-1e4c-44b6-997f-0c1bafe85fd7 nodeName:}" failed. No retries permitted until 2026-07-09 16:04:01.225832371 +0000 UTC m=+18.297428302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2c76" (UniqueName: "kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76") pod "network-check-target-vv4cv" (UID: "aa412a52-1e4c-44b6-997f-0c1bafe85fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:03:53.507002 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:53.506499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:53.507002 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:53.506609 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:03:53.507002 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:53.506643 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:53.507002 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:53.506760 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:03:53.507002 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:53.506828 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:53.507002 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:53.506922 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:03:55.507029 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:55.506569 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:55.507029 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:55.506579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:55.507029 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:55.506713 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:03:55.507029 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:55.506744 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:55.507029 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:55.506859 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:03:55.507029 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:55.506917 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:03:57.505435 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:57.505409 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:57.505812 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:57.505562 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:03:57.505970 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:57.505948 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:57.506053 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:57.506032 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:03:57.506199 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:57.506178 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:57.506313 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:57.506296 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:03:58.578278 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.577990 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xb65r" event={"ID":"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca","Type":"ContainerStarted","Data":"83d7c976da22474e5c52012970bf3d15c6159cd63487b2cb8bb20afab3dee1df"} Jul 09 16:03:58.579825 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.579786 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p8lkl" event={"ID":"97458a95-03a2-4b60-aeef-a34cc99f2218","Type":"ContainerStarted","Data":"86e868649fe8f42d2135b610f87b1fe388f71746456104ac0deb8d2a2301e725"} Jul 09 16:03:58.581821 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.581750 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hn2fx" event={"ID":"f91294fb-ac44-48d8-a7b2-fbb8941bbce9","Type":"ContainerStarted","Data":"d65a2357e3fca6bde6a457f87db5d43d5d1d81665e6a2dab1886bac49fd5bd64"} Jul 09 16:03:58.584227 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.584190 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" event={"ID":"706dc0ba20d5b2176781c9e08f11c9d5","Type":"ContainerStarted","Data":"19a8ed6eeec8776ec2f26ff5a683b751a24a23ec449a9fb552a4fc14b898e6b1"} Jul 09 16:03:58.586695 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.586362 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8nqhq" event={"ID":"eef619ed-c5fa-4806-ba7f-c1799b636cc0","Type":"ContainerStarted","Data":"2f74b1abb4bd9fed350e7793b9ec80678cc451462f75c9cd4be1ede6d3b67d3f"} Jul 09 16:03:58.589678 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.589650 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" event={"ID":"e4d18ef1-a307-414c-bdad-c0df35ac836c","Type":"ContainerStarted","Data":"1dc213f6e864f96c3198e4cb26b8e6aedd2f4b6118d699e91e4d7cc2dc09263b"} Jul 09 16:03:58.592396 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.592373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" event={"ID":"05b64064-68ff-4a52-b45b-29868161089d","Type":"ContainerStarted","Data":"698bc2d5249da3aee4d10fca0c109cf60eb770568a48c7cf66532a9b72f4799c"} Jul 09 16:03:58.604703 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.604640 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" podStartSLOduration=13.604624716 podStartE2EDuration="13.604624716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:03:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:03:47.56817464 +0000 UTC m=+4.639770595" watchObservedRunningTime="2026-07-09 16:03:58.604624716 +0000 UTC m=+15.676220670" Jul 09 16:03:58.640356 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.640306 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vb7qf" podStartSLOduration=2.681029215 podStartE2EDuration="14.640287506s" totalImagesPullingTime="11.959258291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:03:58.622706036 +0000 UTC m=+15.694302005" watchObservedRunningTime="2026-07-09 16:03:58.640287506 +0000 UTC m=+15.711883456" Jul 09 16:03:58.672353 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.672303 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8nqhq" podStartSLOduration=3.082916123 podStartE2EDuration="14.672283313s" totalImagesPullingTime="11.58936719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:03:58.639880582 +0000 UTC m=+15.711476533" watchObservedRunningTime="2026-07-09 16:03:58.672283313 +0000 UTC m=+15.743879263" Jul 09 16:03:58.706825 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.706770 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p8lkl" podStartSLOduration=3.144332541 podStartE2EDuration="14.706750166s" totalImagesPullingTime="11.562417625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:03:58.706336187 +0000 UTC m=+15.777932136" watchObservedRunningTime="2026-07-09 16:03:58.706750166 +0000 UTC m=+15.778346119" Jul 09 16:03:58.706972 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:58.706927 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hn2fx" podStartSLOduration=3.084967629 podStartE2EDuration="14.706920419s" totalImagesPullingTime="11.62195279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:03:58.690792621 +0000 UTC m=+15.762388572" watchObservedRunningTime="2026-07-09 16:03:58.706920419 +0000 UTC m=+15.778516373" Jul 09 16:03:59.509056 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:59.508991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:03:59.509187 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:59.508995 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:03:59.509187 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:59.508997 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:03:59.509296 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:59.509220 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:03:59.509296 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:59.509089 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:03:59.509296 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:03:59.509283 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:03:59.546153 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:59.546118 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:03:59.546768 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:59.546745 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:03:59.595994 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:59.595959 2581 generic.go:356] "Generic (PLEG): container finished" podID="706dc0ba20d5b2176781c9e08f11c9d5" containerID="19a8ed6eeec8776ec2f26ff5a683b751a24a23ec449a9fb552a4fc14b898e6b1" exitCode=0 Jul 09 16:03:59.596588 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:59.596045 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" event={"ID":"706dc0ba20d5b2176781c9e08f11c9d5","Type":"ContainerDied","Data":"19a8ed6eeec8776ec2f26ff5a683b751a24a23ec449a9fb552a4fc14b898e6b1"} Jul 09 16:03:59.598274 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:59.598242 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxl8f" event={"ID":"12db79fe-1de5-4e03-9baf-a54794d69eaa","Type":"ContainerStarted","Data":"c3cb8ff544783c55ef5cd3dccb16906e852ec0ccbedf332fb3c2231da63b9de1"} Jul 09 16:03:59.629886 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:03:59.629834 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hxl8f" podStartSLOduration=3.991492486 podStartE2EDuration="15.629817316s" totalImagesPullingTime="11.63832483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:03:59.629413842 +0000 UTC m=+16.701009794" watchObservedRunningTime="2026-07-09 16:03:59.629817316 +0000 UTC m=+16.701413266" Jul 09 16:04:00.600743 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:00.600698 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 16:04:01.084699 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:01.084599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:01.084955 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:01.084773 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:04:01.084955 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:01.084839 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs podName:865c284a-ea51-4053-9d3e-32524736479b nodeName:}" failed. No retries permitted until 2026-07-09 16:04:17.084811666 +0000 UTC m=+34.156407594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs") pod "network-metrics-daemon-k74h8" (UID: "865c284a-ea51-4053-9d3e-32524736479b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:04:01.185336 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:01.185302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:01.185539 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:01.185424 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:04:01.185539 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:01.185509 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret podName:cf5a02de-1a51-4524-a37a-4be5b379712c nodeName:}" failed. No retries permitted until 2026-07-09 16:04:17.185489685 +0000 UTC m=+34.257085615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret") pod "global-pull-secret-syncer-fvv7c" (UID: "cf5a02de-1a51-4524-a37a-4be5b379712c") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:04:01.286193 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:01.286152 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2c76\" (UniqueName: \"kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76\") pod \"network-check-target-vv4cv\" (UID: \"aa412a52-1e4c-44b6-997f-0c1bafe85fd7\") " pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:01.286349 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:01.286330 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:04:01.286395 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:01.286354 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:04:01.286395 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:01.286365 2581 projected.go:196] Error preparing data for projected volume kube-api-access-l2c76 for pod openshift-network-diagnostics/network-check-target-vv4cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:04:01.286516 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:01.286434 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76 podName:aa412a52-1e4c-44b6-997f-0c1bafe85fd7 nodeName:}" failed. No retries permitted until 2026-07-09 16:04:17.286417376 +0000 UTC m=+34.358013325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2c76" (UniqueName: "kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76") pod "network-check-target-vv4cv" (UID: "aa412a52-1e4c-44b6-997f-0c1bafe85fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:04:01.505783 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:01.505698 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:01.505783 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:01.505727 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:01.505783 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:01.505773 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:01.506033 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:01.505893 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:04:01.506277 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:01.506255 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:04:01.506340 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:01.506315 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:04:03.505984 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:03.505590 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:03.506563 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:03.506005 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:04:03.506563 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:03.506337 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:03.506563 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:03.506399 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:04:03.506563 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:03.506441 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:03.506563 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:03.506522 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:04:03.610896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:03.610861 2581 generic.go:356] "Generic (PLEG): container finished" podID="8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca" containerID="83d7c976da22474e5c52012970bf3d15c6159cd63487b2cb8bb20afab3dee1df" exitCode=0 Jul 09 16:04:03.611081 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:03.610914 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xb65r" event={"ID":"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca","Type":"ContainerDied","Data":"83d7c976da22474e5c52012970bf3d15c6159cd63487b2cb8bb20afab3dee1df"} Jul 09 16:04:05.506003 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:05.505965 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:05.506457 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:05.505974 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:05.506457 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:05.506102 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:04:05.506457 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:05.505974 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:05.506457 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:05.506173 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:04:05.506457 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:05.506258 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:04:07.267794 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.267514 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 16:04:07.407607 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.407357 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T16:04:07.267530301Z","UUID":"38c2651c-233d-4a23-82ba-bcdbdca4d94f","Handler":null,"Name":"","Endpoint":""} Jul 09 16:04:07.408757 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.408739 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 16:04:07.408853 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.408775 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 16:04:07.505224 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.505196 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:07.505327 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.505229 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:07.505327 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.505198 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:07.505405 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:07.505316 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:04:07.505405 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:07.505357 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:04:07.505504 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:07.505426 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:04:07.620412 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.620381 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z95sg" event={"ID":"4ab0b329-22ff-4c9f-b350-73462deaae48","Type":"ContainerStarted","Data":"f66cc166d28dd0fef4e4c53a19d971c853cd5b0e629e198f4d7c9fc163955fe6"} Jul 09 16:04:07.622665 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.622641 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" event={"ID":"706dc0ba20d5b2176781c9e08f11c9d5","Type":"ContainerStarted","Data":"71e99f75755e0029c82ed9460b65743dd3854ac9ee63c70fd7e52b06e2c0d8c6"} Jul 09 16:04:07.625708 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.625497 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" event={"ID":"05b64064-68ff-4a52-b45b-29868161089d","Type":"ContainerStarted","Data":"4b413e9370123a4c039c9acdab2930b1e478db56cad9531068a900d6d1f6f14d"} Jul 09 16:04:07.628633 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.628615 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:04:07.628986 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.628962 2581 generic.go:356] "Generic (PLEG): container finished" podID="244c6150-ca46-4324-9b34-b5e812e5dd40" containerID="de5c44f9023dc0f6d7d7b80170057085a81e95273744369a490c408e01688539" exitCode=1 Jul 09 16:04:07.629114 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.629000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" event={"ID":"244c6150-ca46-4324-9b34-b5e812e5dd40","Type":"ContainerStarted","Data":"1f8cc39fd0242fd59f14b491538a9be53fdb50b6169c737dcb94ecc0fecc9441"} Jul 09 16:04:07.629114 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.629066 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" event={"ID":"244c6150-ca46-4324-9b34-b5e812e5dd40","Type":"ContainerStarted","Data":"8d2027cb238eef29c42a9c782302d6f1629ea7a99fea64860634dc5788acecf9"} Jul 09 16:04:07.629185 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.629118 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" event={"ID":"244c6150-ca46-4324-9b34-b5e812e5dd40","Type":"ContainerStarted","Data":"9dffba575a6c235dbb92b274bafe0a299ca382ddd2515d4eed22fb41e3252afc"} Jul 09 16:04:07.629185 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.629161 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" event={"ID":"244c6150-ca46-4324-9b34-b5e812e5dd40","Type":"ContainerDied","Data":"de5c44f9023dc0f6d7d7b80170057085a81e95273744369a490c408e01688539"} Jul 09 16:04:07.629240 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.629209 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" event={"ID":"244c6150-ca46-4324-9b34-b5e812e5dd40","Type":"ContainerStarted","Data":"0916338e6c61594d7425adab4062a66e834640d07882b0f44c2b4049a14db04c"} Jul 09 16:04:07.643127 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.643087 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z95sg" podStartSLOduration=2.263024674 podStartE2EDuration="23.64307289s" totalImagesPullingTime="21.380048216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:04:07.642755411 +0000 UTC m=+24.714351361" watchObservedRunningTime="2026-07-09 16:04:07.64307289 +0000 UTC m=+24.714668839" Jul 09 16:04:07.659222 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:07.659054 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" podStartSLOduration=22.659034013 podStartE2EDuration="22.659034013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:03:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:04:07.658623711 +0000 UTC m=+24.730219663" watchObservedRunningTime="2026-07-09 16:04:07.659034013 +0000 UTC m=+24.730629964" Jul 09 16:04:08.635394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:08.635366 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:04:08.636435 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:08.636024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" event={"ID":"244c6150-ca46-4324-9b34-b5e812e5dd40","Type":"ContainerStarted","Data":"5ee6641adef1ca23283cc25f88c6a38a6acb22156c626476bf9a4df32d80e8ac"} Jul 09 16:04:09.504947 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:09.504868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:09.505160 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:09.504868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:09.505160 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:09.504980 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:09.505160 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:09.504976 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:04:09.505160 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:09.505057 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:04:09.505160 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:09.505121 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:04:09.639704 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:09.639671 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" event={"ID":"05b64064-68ff-4a52-b45b-29868161089d","Type":"ContainerStarted","Data":"ebf2db6303ee2ee2f4437a975997f66d43b2b70c81a3f32a34fe2cf97f27a2ad"} Jul 09 16:04:09.661769 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:09.661722 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl8wx" podStartSLOduration=3.24374649 podStartE2EDuration="25.661707884s" totalImagesPullingTime="22.417961394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:03:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:04:09.661294618 +0000 UTC m=+26.732890583" watchObservedRunningTime="2026-07-09 16:04:09.661707884 +0000 UTC m=+26.733303833" Jul 09 16:04:10.645290 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:10.645263 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:04:10.645813 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:10.645682 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" event={"ID":"244c6150-ca46-4324-9b34-b5e812e5dd40","Type":"ContainerStarted","Data":"65cd18e674a1041d23e20e5e1420a99b7b78a23f6b0c1c2e66e3d2f52ab4186f"} Jul 09 16:04:11.505300 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:11.505266 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:11.505524 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:11.505397 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:04:11.505524 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:11.505451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:11.505627 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:11.505533 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:11.505660 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:11.505629 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:04:11.505707 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:11.505690 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:04:12.965410 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:12.965372 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:04:12.965836 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:12.965579 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 16:04:12.966066 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:12.966041 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p8lkl" Jul 09 16:04:13.507078 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:13.506844 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:13.507172 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:13.506890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:13.507215 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:13.507186 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:04:13.507258 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:13.506914 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:13.507258 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:13.507226 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:04:13.507333 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:13.507319 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:04:13.655930 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:13.655844 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:04:13.656222 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:13.656193 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" event={"ID":"244c6150-ca46-4324-9b34-b5e812e5dd40","Type":"ContainerStarted","Data":"4539cdeb1b5ffcf5229ca3a75072228813b3ddc45f318a013ba921845c83ca04"} Jul 09 16:04:13.656458 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:13.656432 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:04:13.656552 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:13.656527 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:04:13.656673 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:13.656658 2581 scope.go:117] "RemoveContainer" containerID="de5c44f9023dc0f6d7d7b80170057085a81e95273744369a490c408e01688539" Jul 09 16:04:13.658332 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:13.658310 2581 generic.go:356] "Generic (PLEG): container finished" podID="8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca" containerID="55fcd7f7d01d430809cd33a600bb601a121bd9e0102ac952a3cfc2fde375485c" exitCode=0 Jul 09 16:04:13.658411 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:13.658388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xb65r" event={"ID":"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca","Type":"ContainerDied","Data":"55fcd7f7d01d430809cd33a600bb601a121bd9e0102ac952a3cfc2fde375485c"} Jul 09 16:04:13.674822 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:13.674798 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:04:14.664125 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:14.664101 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:04:14.664668 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:14.664490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" event={"ID":"244c6150-ca46-4324-9b34-b5e812e5dd40","Type":"ContainerStarted","Data":"be0ce1ebee5ec62c9b555acd698e28c69793230cf59cc03ffec38bcfa8bb4918"} Jul 09 16:04:14.664846 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:14.664825 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:04:14.680432 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:14.680407 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:04:14.693180 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:14.693137 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" podStartSLOduration=9.289851193 podStartE2EDuration="30.693119572s" totalImagesPullingTime="21.403268379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:04:14.692867024 +0000 UTC m=+31.764462973" watchObservedRunningTime="2026-07-09 16:04:14.693119572 +0000 UTC m=+31.764715521" Jul 09 16:04:15.081977 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:15.081798 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fvv7c"] Jul 09 16:04:15.082143 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:15.082111 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:15.082254 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:15.082226 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:04:15.086480 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:15.086442 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k74h8"] Jul 09 16:04:15.086591 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:15.086554 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:15.086647 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:15.086625 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:04:15.089312 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:15.089292 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vv4cv"] Jul 09 16:04:15.089407 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:15.089377 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:15.089458 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:15.089440 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:04:15.668553 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:15.668522 2581 generic.go:356] "Generic (PLEG): container finished" podID="8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca" containerID="ec18e96d7c750bfa9252d9ed170655e1e9659dff41dd5d0e6d72e9090bde591d" exitCode=0 Jul 09 16:04:15.669033 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:15.668591 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xb65r" event={"ID":"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca","Type":"ContainerDied","Data":"ec18e96d7c750bfa9252d9ed170655e1e9659dff41dd5d0e6d72e9090bde591d"} Jul 09 16:04:16.506239 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:16.505775 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:16.506239 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:16.505820 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:16.506239 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:16.505884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:16.506239 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:16.505904 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:04:16.506239 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:16.505966 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:04:16.506239 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:16.506054 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:04:16.674520 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:16.674482 2581 generic.go:356] "Generic (PLEG): container finished" podID="8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca" containerID="410ed87597dd54df923d9d9018e4f660f20cb1c29f9b14a57cc16f6128756fc2" exitCode=0 Jul 09 16:04:16.674520 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:16.674511 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xb65r" event={"ID":"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca","Type":"ContainerDied","Data":"410ed87597dd54df923d9d9018e4f660f20cb1c29f9b14a57cc16f6128756fc2"} Jul 09 16:04:17.104672 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:17.104638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:17.104834 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:17.104781 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:04:17.104879 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:17.104843 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs podName:865c284a-ea51-4053-9d3e-32524736479b nodeName:}" failed. No retries permitted until 2026-07-09 16:04:49.104827234 +0000 UTC m=+66.176423165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs") pod "network-metrics-daemon-k74h8" (UID: "865c284a-ea51-4053-9d3e-32524736479b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:04:17.205670 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:17.205637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:17.205834 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:17.205783 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:04:17.205873 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:17.205839 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret podName:cf5a02de-1a51-4524-a37a-4be5b379712c nodeName:}" failed. No retries permitted until 2026-07-09 16:04:49.205824938 +0000 UTC m=+66.277420866 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret") pod "global-pull-secret-syncer-fvv7c" (UID: "cf5a02de-1a51-4524-a37a-4be5b379712c") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:04:17.306357 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:17.306328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2c76\" (UniqueName: \"kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76\") pod \"network-check-target-vv4cv\" (UID: \"aa412a52-1e4c-44b6-997f-0c1bafe85fd7\") " pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:17.306532 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:17.306438 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:04:17.306532 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:17.306451 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:04:17.306532 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:17.306459 2581 projected.go:196] Error preparing data for projected volume kube-api-access-l2c76 for pod openshift-network-diagnostics/network-check-target-vv4cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:04:17.306532 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:17.306514 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76 podName:aa412a52-1e4c-44b6-997f-0c1bafe85fd7 nodeName:}" failed. No retries permitted until 2026-07-09 16:04:49.306501625 +0000 UTC m=+66.378097554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l2c76" (UniqueName: "kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76") pod "network-check-target-vv4cv" (UID: "aa412a52-1e4c-44b6-997f-0c1bafe85fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:04:18.505290 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:18.505253 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:18.505290 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:18.505286 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:18.505887 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:18.505286 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:18.505887 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:18.505385 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvv7c" podUID="cf5a02de-1a51-4524-a37a-4be5b379712c" Jul 09 16:04:18.505887 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:18.505483 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vv4cv" podUID="aa412a52-1e4c-44b6-997f-0c1bafe85fd7" Jul 09 16:04:18.505887 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:18.505565 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:04:19.740118 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.740087 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeReady" Jul 09 16:04:19.740739 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.740259 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 16:04:19.786391 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.786314 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67ddb9dcfb-dx5pl"] Jul 09 16:04:19.790259 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.790236 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ntv5m"] Jul 09 16:04:19.790399 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.790372 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:19.793953 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.793934 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:19.794585 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.794560 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rpd2k"] Jul 09 16:04:19.796662 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.796641 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 16:04:19.796961 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.796841 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 16:04:19.797960 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.797940 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rpd2k" Jul 09 16:04:19.798589 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.798293 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tvt5b\"" Jul 09 16:04:19.798589 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.798489 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 16:04:19.799025 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.799006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nnrq4\"" Jul 09 16:04:19.799716 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.799697 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 16:04:19.799800 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.799754 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 16:04:19.801653 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.801636 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 16:04:19.801752 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.801688 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 16:04:19.801900 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.801879 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ddkpg\"" Jul 09 16:04:19.802076 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.802062 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 16:04:19.818431 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.818409 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 16:04:19.823238 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.823215 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67ddb9dcfb-dx5pl"] Jul 09 16:04:19.824166 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.824143 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ntv5m"] Jul 09 16:04:19.839276 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.839241 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rpd2k"] Jul 09 16:04:19.929686 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.929654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/111dae17-df4c-4556-adbe-55f1988aa74c-ca-trust-extracted\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:19.929686 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.929686 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1ec37ae-7ff5-450e-be11-110cd92c71ad-config-volume\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:19.929937 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.929721 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-image-registry-private-configuration\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:19.929937 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.929753 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-bound-sa-token\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:19.929937 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.929815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:19.929937 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.929857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ec37ae-7ff5-450e-be11-110cd92c71ad-tmp-dir\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:19.929937 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.929884 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86fj8\" (UniqueName: \"kubernetes.io/projected/a1ec37ae-7ff5-450e-be11-110cd92c71ad-kube-api-access-86fj8\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:19.929937 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.929917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62121c21-50ff-4149-80f8-9fcbd30865d4-cert\") pod \"ingress-canary-rpd2k\" (UID: \"62121c21-50ff-4149-80f8-9fcbd30865d4\") " pod="openshift-ingress-canary/ingress-canary-rpd2k" Jul 09 16:04:19.930232 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.929971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lspw9\" (UniqueName: \"kubernetes.io/projected/62121c21-50ff-4149-80f8-9fcbd30865d4-kube-api-access-lspw9\") pod \"ingress-canary-rpd2k\" (UID: \"62121c21-50ff-4149-80f8-9fcbd30865d4\") " pod="openshift-ingress-canary/ingress-canary-rpd2k" Jul 09 16:04:19.930232 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.930015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jqq9\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-kube-api-access-2jqq9\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:19.930232 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.930067 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-registry-certificates\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:19.930232 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.930092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-installation-pull-secrets\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:19.930232 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.930117 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-trusted-ca\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:19.930232 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:19.930140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:20.030937 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.030899 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62121c21-50ff-4149-80f8-9fcbd30865d4-cert\") pod \"ingress-canary-rpd2k\" (UID: \"62121c21-50ff-4149-80f8-9fcbd30865d4\") " pod="openshift-ingress-canary/ingress-canary-rpd2k" Jul 09 16:04:20.031085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.030957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lspw9\" (UniqueName: \"kubernetes.io/projected/62121c21-50ff-4149-80f8-9fcbd30865d4-kube-api-access-lspw9\") pod \"ingress-canary-rpd2k\" (UID: \"62121c21-50ff-4149-80f8-9fcbd30865d4\") " pod="openshift-ingress-canary/ingress-canary-rpd2k" Jul 09 16:04:20.031085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.030983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqq9\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-kube-api-access-2jqq9\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.031085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-registry-certificates\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.031085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-installation-pull-secrets\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.031085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-trusted-ca\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.031085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:20.031410 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031101 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/111dae17-df4c-4556-adbe-55f1988aa74c-ca-trust-extracted\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.031410 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1ec37ae-7ff5-450e-be11-110cd92c71ad-config-volume\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:20.031410 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-image-registry-private-configuration\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.031410 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031185 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-bound-sa-token\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.031410 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.031410 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ec37ae-7ff5-450e-be11-110cd92c71ad-tmp-dir\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:20.031410 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86fj8\" (UniqueName: \"kubernetes.io/projected/a1ec37ae-7ff5-450e-be11-110cd92c71ad-kube-api-access-86fj8\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:20.031798 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:20.031425 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:04:20.031798 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:20.031520 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls podName:a1ec37ae-7ff5-450e-be11-110cd92c71ad nodeName:}" failed. No retries permitted until 2026-07-09 16:04:20.531499168 +0000 UTC m=+37.603095109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls") pod "dns-default-ntv5m" (UID: "a1ec37ae-7ff5-450e-be11-110cd92c71ad") : secret "dns-default-metrics-tls" not found Jul 09 16:04:20.031798 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:20.031623 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:04:20.031798 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:20.031639 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67ddb9dcfb-dx5pl: secret "image-registry-tls" not found Jul 09 16:04:20.031798 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.031677 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/111dae17-df4c-4556-adbe-55f1988aa74c-ca-trust-extracted\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.031798 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:20.031683 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls podName:111dae17-df4c-4556-adbe-55f1988aa74c nodeName:}" failed. No retries permitted until 2026-07-09 16:04:20.53166834 +0000 UTC m=+37.603264283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls") pod "image-registry-67ddb9dcfb-dx5pl" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c") : secret "image-registry-tls" not found Jul 09 16:04:20.032107 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.032044 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ec37ae-7ff5-450e-be11-110cd92c71ad-tmp-dir\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:20.032107 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.032065 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-registry-certificates\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.032208 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.032145 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1ec37ae-7ff5-450e-be11-110cd92c71ad-config-volume\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:20.032208 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.032152 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-trusted-ca\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.035588 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.035438 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-installation-pull-secrets\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.035694 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.035455 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62121c21-50ff-4149-80f8-9fcbd30865d4-cert\") pod \"ingress-canary-rpd2k\" (UID: \"62121c21-50ff-4149-80f8-9fcbd30865d4\") " pod="openshift-ingress-canary/ingress-canary-rpd2k" Jul 09 16:04:20.035694 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.035461 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-image-registry-private-configuration\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.044036 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.043967 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86fj8\" (UniqueName: \"kubernetes.io/projected/a1ec37ae-7ff5-450e-be11-110cd92c71ad-kube-api-access-86fj8\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:20.044124 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.044057 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lspw9\" (UniqueName: \"kubernetes.io/projected/62121c21-50ff-4149-80f8-9fcbd30865d4-kube-api-access-lspw9\") pod \"ingress-canary-rpd2k\" (UID: \"62121c21-50ff-4149-80f8-9fcbd30865d4\") " pod="openshift-ingress-canary/ingress-canary-rpd2k" Jul 09 16:04:20.044397 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.044376 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-bound-sa-token\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.044531 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.044517 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jqq9\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-kube-api-access-2jqq9\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.117896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.117867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rpd2k" Jul 09 16:04:20.278634 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.278602 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rpd2k"] Jul 09 16:04:20.282827 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:04:20.282802 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62121c21_50ff_4149_80f8_9fcbd30865d4.slice/crio-c1eefbb1cd85f547dddf705eefd0b6cfdd92b9d594bbe0ce711fd6db2f07da6b WatchSource:0}: Error finding container c1eefbb1cd85f547dddf705eefd0b6cfdd92b9d594bbe0ce711fd6db2f07da6b: Status 404 returned error can't find the container with id c1eefbb1cd85f547dddf705eefd0b6cfdd92b9d594bbe0ce711fd6db2f07da6b Jul 09 16:04:20.505160 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.505043 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:20.505160 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.505080 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:20.505369 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.505233 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:20.509842 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.509360 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gdktf\"" Jul 09 16:04:20.509842 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.509401 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzqd2\"" Jul 09 16:04:20.509842 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.509419 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 16:04:20.509842 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.509454 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 16:04:20.509842 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.509552 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 16:04:20.509842 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.509683 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 16:04:20.535651 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.535628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:20.535757 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.535676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:20.535817 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:20.535788 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:04:20.535817 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:20.535790 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:04:20.535817 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:20.535811 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67ddb9dcfb-dx5pl: secret "image-registry-tls" not found Jul 09 16:04:20.535941 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:20.535850 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls podName:a1ec37ae-7ff5-450e-be11-110cd92c71ad nodeName:}" failed. No retries permitted until 2026-07-09 16:04:21.535831654 +0000 UTC m=+38.607427596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls") pod "dns-default-ntv5m" (UID: "a1ec37ae-7ff5-450e-be11-110cd92c71ad") : secret "dns-default-metrics-tls" not found Jul 09 16:04:20.535941 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:20.535872 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls podName:111dae17-df4c-4556-adbe-55f1988aa74c nodeName:}" failed. No retries permitted until 2026-07-09 16:04:21.535860478 +0000 UTC m=+38.607456411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls") pod "image-registry-67ddb9dcfb-dx5pl" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c") : secret "image-registry-tls" not found Jul 09 16:04:20.686535 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:20.686494 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rpd2k" event={"ID":"62121c21-50ff-4149-80f8-9fcbd30865d4","Type":"ContainerStarted","Data":"c1eefbb1cd85f547dddf705eefd0b6cfdd92b9d594bbe0ce711fd6db2f07da6b"} Jul 09 16:04:21.543771 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:21.543739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:21.544241 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:21.543800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:21.544241 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:21.543902 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:04:21.544241 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:21.543933 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:04:21.544241 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:21.543952 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67ddb9dcfb-dx5pl: secret "image-registry-tls" not found Jul 09 16:04:21.544241 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:21.543982 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls podName:a1ec37ae-7ff5-450e-be11-110cd92c71ad nodeName:}" failed. No retries permitted until 2026-07-09 16:04:23.543958433 +0000 UTC m=+40.615554362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls") pod "dns-default-ntv5m" (UID: "a1ec37ae-7ff5-450e-be11-110cd92c71ad") : secret "dns-default-metrics-tls" not found Jul 09 16:04:21.544241 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:21.544008 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls podName:111dae17-df4c-4556-adbe-55f1988aa74c nodeName:}" failed. No retries permitted until 2026-07-09 16:04:23.543990776 +0000 UTC m=+40.615586731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls") pod "image-registry-67ddb9dcfb-dx5pl" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c") : secret "image-registry-tls" not found Jul 09 16:04:23.560072 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:23.560031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:23.560549 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:23.560110 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:23.560549 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:23.560218 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:04:23.560549 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:23.560306 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:04:23.560549 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:23.560323 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67ddb9dcfb-dx5pl: secret "image-registry-tls" not found Jul 09 16:04:23.560549 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:23.560340 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls podName:a1ec37ae-7ff5-450e-be11-110cd92c71ad nodeName:}" failed. No retries permitted until 2026-07-09 16:04:27.560320069 +0000 UTC m=+44.631916002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls") pod "dns-default-ntv5m" (UID: "a1ec37ae-7ff5-450e-be11-110cd92c71ad") : secret "dns-default-metrics-tls" not found Jul 09 16:04:23.560549 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:23.560391 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls podName:111dae17-df4c-4556-adbe-55f1988aa74c nodeName:}" failed. No retries permitted until 2026-07-09 16:04:27.56037178 +0000 UTC m=+44.631967712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls") pod "image-registry-67ddb9dcfb-dx5pl" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c") : secret "image-registry-tls" not found Jul 09 16:04:24.697497 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:24.697282 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rpd2k" event={"ID":"62121c21-50ff-4149-80f8-9fcbd30865d4","Type":"ContainerStarted","Data":"193c44d3ce0d0c40cef2ef1aab91d5a1ab75c857053a25fdb7cc31e07ff77f5f"} Jul 09 16:04:24.700062 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:24.700038 2581 generic.go:356] "Generic (PLEG): container finished" podID="8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca" containerID="d3a5ebbc578ea6663b401bdd65cd127e13d826310adcb2129957c636413cad7c" exitCode=0 Jul 09 16:04:24.700162 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:24.700077 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xb65r" event={"ID":"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca","Type":"ContainerDied","Data":"d3a5ebbc578ea6663b401bdd65cd127e13d826310adcb2129957c636413cad7c"} Jul 09 16:04:24.712300 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:24.712259 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rpd2k" podStartSLOduration=1.677834981 podStartE2EDuration="5.712245443s" totalImagesPullingTime="4.034410462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:04:24.711973665 +0000 UTC m=+41.783569612" watchObservedRunningTime="2026-07-09 16:04:24.712245443 +0000 UTC m=+41.783841423" Jul 09 16:04:25.706179 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:25.706141 2581 generic.go:356] "Generic (PLEG): container finished" podID="8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca" containerID="f20397aa541a3b00a8de345b1defaca9bffaab37310a96552e0100e23323f6a2" exitCode=0 Jul 09 16:04:25.706768 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:25.706214 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xb65r" event={"ID":"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca","Type":"ContainerDied","Data":"f20397aa541a3b00a8de345b1defaca9bffaab37310a96552e0100e23323f6a2"} Jul 09 16:04:26.712352 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:26.712311 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xb65r" event={"ID":"8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca","Type":"ContainerStarted","Data":"9a51ceb4a4d3fc526e54494e7677c84e47234323742164360752e729d6eb3b6e"} Jul 09 16:04:26.737775 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:26.737723 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xb65r" podStartSLOduration=12.774371486 podStartE2EDuration="43.737702966s" totalImagesPullingTime="30.96333148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:03:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:04:26.735744437 +0000 UTC m=+43.807340386" watchObservedRunningTime="2026-07-09 16:04:26.737702966 +0000 UTC m=+43.809298915" Jul 09 16:04:27.593031 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:27.592844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:27.593031 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:27.593016 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:04:27.593229 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:27.593059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:27.593229 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:27.593102 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls podName:a1ec37ae-7ff5-450e-be11-110cd92c71ad nodeName:}" failed. No retries permitted until 2026-07-09 16:04:35.593086891 +0000 UTC m=+52.664682819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls") pod "dns-default-ntv5m" (UID: "a1ec37ae-7ff5-450e-be11-110cd92c71ad") : secret "dns-default-metrics-tls" not found Jul 09 16:04:27.593229 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:27.593159 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:04:27.593229 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:27.593170 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67ddb9dcfb-dx5pl: secret "image-registry-tls" not found Jul 09 16:04:27.593229 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:27.593208 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls podName:111dae17-df4c-4556-adbe-55f1988aa74c nodeName:}" failed. No retries permitted until 2026-07-09 16:04:35.59319833 +0000 UTC m=+52.664794261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls") pod "image-registry-67ddb9dcfb-dx5pl" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c") : secret "image-registry-tls" not found Jul 09 16:04:35.651611 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:35.651572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:35.652175 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:35.651632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:35.652175 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:35.651731 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:04:35.652175 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:35.651755 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:04:35.652175 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:35.651766 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67ddb9dcfb-dx5pl: secret "image-registry-tls" not found Jul 09 16:04:35.652175 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:35.651795 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls podName:a1ec37ae-7ff5-450e-be11-110cd92c71ad nodeName:}" failed. No retries permitted until 2026-07-09 16:04:51.651780626 +0000 UTC m=+68.723376554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls") pod "dns-default-ntv5m" (UID: "a1ec37ae-7ff5-450e-be11-110cd92c71ad") : secret "dns-default-metrics-tls" not found Jul 09 16:04:35.652175 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:35.651809 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls podName:111dae17-df4c-4556-adbe-55f1988aa74c nodeName:}" failed. No retries permitted until 2026-07-09 16:04:51.651803715 +0000 UTC m=+68.723399642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls") pod "image-registry-67ddb9dcfb-dx5pl" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c") : secret "image-registry-tls" not found Jul 09 16:04:46.685348 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:46.685319 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbvp4" Jul 09 16:04:49.149619 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.149581 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:04:49.152639 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.152619 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 16:04:49.160136 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:49.160116 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 16:04:49.160211 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:49.160198 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs podName:865c284a-ea51-4053-9d3e-32524736479b nodeName:}" failed. No retries permitted until 2026-07-09 16:05:53.160161456 +0000 UTC m=+130.231757384 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs") pod "network-metrics-daemon-k74h8" (UID: "865c284a-ea51-4053-9d3e-32524736479b") : secret "metrics-daemon-secret" not found Jul 09 16:04:49.250196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.250159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:49.254206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.254185 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 16:04:49.264678 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.264653 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf5a02de-1a51-4524-a37a-4be5b379712c-original-pull-secret\") pod \"global-pull-secret-syncer-fvv7c\" (UID: \"cf5a02de-1a51-4524-a37a-4be5b379712c\") " pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:49.325207 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.325172 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvv7c" Jul 09 16:04:49.351245 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.351211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2c76\" (UniqueName: \"kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76\") pod \"network-check-target-vv4cv\" (UID: \"aa412a52-1e4c-44b6-997f-0c1bafe85fd7\") " pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:49.354423 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.354401 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 16:04:49.364766 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.364746 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 16:04:49.375021 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.374973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2c76\" (UniqueName: \"kubernetes.io/projected/aa412a52-1e4c-44b6-997f-0c1bafe85fd7-kube-api-access-l2c76\") pod \"network-check-target-vv4cv\" (UID: \"aa412a52-1e4c-44b6-997f-0c1bafe85fd7\") " pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:49.465679 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.465648 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fvv7c"] Jul 09 16:04:49.469936 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:04:49.469904 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5a02de_1a51_4524_a37a_4be5b379712c.slice/crio-85d9141ee175b9649ccda1a6d39364b499c8eeab84f49b417e154bfe12f57141 WatchSource:0}: Error finding container 85d9141ee175b9649ccda1a6d39364b499c8eeab84f49b417e154bfe12f57141: Status 404 returned error can't find the container with id 85d9141ee175b9649ccda1a6d39364b499c8eeab84f49b417e154bfe12f57141 Jul 09 16:04:49.621126 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.621088 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzqd2\"" Jul 09 16:04:49.628397 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.628375 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:49.747958 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.747928 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vv4cv"] Jul 09 16:04:49.750814 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:04:49.750768 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa412a52_1e4c_44b6_997f_0c1bafe85fd7.slice/crio-5448e5655f1c0f16335d6e8b2312b78b010ab676ce7ef3cf438dbeb8228e2a09 WatchSource:0}: Error finding container 5448e5655f1c0f16335d6e8b2312b78b010ab676ce7ef3cf438dbeb8228e2a09: Status 404 returned error can't find the container with id 5448e5655f1c0f16335d6e8b2312b78b010ab676ce7ef3cf438dbeb8228e2a09 Jul 09 16:04:49.765219 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.765183 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vv4cv" event={"ID":"aa412a52-1e4c-44b6-997f-0c1bafe85fd7","Type":"ContainerStarted","Data":"5448e5655f1c0f16335d6e8b2312b78b010ab676ce7ef3cf438dbeb8228e2a09"} Jul 09 16:04:49.766176 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:49.766154 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fvv7c" event={"ID":"cf5a02de-1a51-4524-a37a-4be5b379712c","Type":"ContainerStarted","Data":"85d9141ee175b9649ccda1a6d39364b499c8eeab84f49b417e154bfe12f57141"} Jul 09 16:04:51.668303 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:51.668260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:04:51.668918 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:51.668352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:04:51.668918 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:51.668398 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:04:51.668918 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:51.668416 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67ddb9dcfb-dx5pl: secret "image-registry-tls" not found Jul 09 16:04:51.668918 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:51.668443 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:04:51.668918 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:51.668501 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls podName:111dae17-df4c-4556-adbe-55f1988aa74c nodeName:}" failed. No retries permitted until 2026-07-09 16:05:23.668481978 +0000 UTC m=+100.740077920 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls") pod "image-registry-67ddb9dcfb-dx5pl" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c") : secret "image-registry-tls" not found Jul 09 16:04:51.668918 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:04:51.668519 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls podName:a1ec37ae-7ff5-450e-be11-110cd92c71ad nodeName:}" failed. No retries permitted until 2026-07-09 16:05:23.66850992 +0000 UTC m=+100.740105853 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls") pod "dns-default-ntv5m" (UID: "a1ec37ae-7ff5-450e-be11-110cd92c71ad") : secret "dns-default-metrics-tls" not found Jul 09 16:04:55.782262 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:55.782223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vv4cv" event={"ID":"aa412a52-1e4c-44b6-997f-0c1bafe85fd7","Type":"ContainerStarted","Data":"5454bb774fda6d146e71717bc9b501c591302ca730b310102d11cceb3d15669f"} Jul 09 16:04:55.782783 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:55.782326 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:04:55.784000 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:55.783968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fvv7c" event={"ID":"cf5a02de-1a51-4524-a37a-4be5b379712c","Type":"ContainerStarted","Data":"a09c10257a15bdaf1db53310bb521f167d22baf48f7baf1763a8d1ecff49a4d0"} Jul 09 16:04:55.797539 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:55.797494 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vv4cv" podStartSLOduration=65.904514635 podStartE2EDuration="1m11.797480248s" totalImagesPullingTime="5.892965613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:04:55.796536912 +0000 UTC m=+72.868132862" watchObservedRunningTime="2026-07-09 16:04:55.797480248 +0000 UTC m=+72.869076188" Jul 09 16:04:55.811054 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:04:55.810999 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fvv7c" podStartSLOduration=65.637676329 podStartE2EDuration="1m11.810981375s" totalImagesPullingTime="6.173305046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:04:55.810461163 +0000 UTC m=+72.882057113" watchObservedRunningTime="2026-07-09 16:04:55.810981375 +0000 UTC m=+72.882577327" Jul 09 16:05:23.690803 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:05:23.690682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:05:23.690803 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:05:23.690732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:05:23.691334 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:05:23.690819 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:05:23.691334 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:05:23.690878 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls podName:a1ec37ae-7ff5-450e-be11-110cd92c71ad nodeName:}" failed. No retries permitted until 2026-07-09 16:06:27.690861131 +0000 UTC m=+164.762457058 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls") pod "dns-default-ntv5m" (UID: "a1ec37ae-7ff5-450e-be11-110cd92c71ad") : secret "dns-default-metrics-tls" not found Jul 09 16:05:23.691334 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:05:23.690821 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:05:23.691334 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:05:23.690914 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67ddb9dcfb-dx5pl: secret "image-registry-tls" not found Jul 09 16:05:23.691334 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:05:23.690960 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls podName:111dae17-df4c-4556-adbe-55f1988aa74c nodeName:}" failed. No retries permitted until 2026-07-09 16:06:27.690947874 +0000 UTC m=+164.762543808 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls") pod "image-registry-67ddb9dcfb-dx5pl" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c") : secret "image-registry-tls" not found Jul 09 16:05:26.789625 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:05:26.789596 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vv4cv" Jul 09 16:05:53.209037 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:05:53.208981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:05:53.209544 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:05:53.209154 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 16:05:53.209544 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:05:53.209234 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs podName:865c284a-ea51-4053-9d3e-32524736479b nodeName:}" failed. No retries permitted until 2026-07-09 16:07:55.209215539 +0000 UTC m=+252.280811471 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs") pod "network-metrics-daemon-k74h8" (UID: "865c284a-ea51-4053-9d3e-32524736479b") : secret "metrics-daemon-secret" not found Jul 09 16:06:22.804370 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:06:22.804320 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" podUID="111dae17-df4c-4556-adbe-55f1988aa74c" Jul 09 16:06:22.812461 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:06:22.812419 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ntv5m" podUID="a1ec37ae-7ff5-450e-be11-110cd92c71ad" Jul 09 16:06:22.989262 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:06:22.989231 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntv5m" Jul 09 16:06:22.989413 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:06:22.989276 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:06:23.531208 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:06:23.531171 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:06:27.746531 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:06:27.746488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:06:27.746933 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:06:27.746542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:06:27.746933 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:06:27.746646 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 16:06:27.746933 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:06:27.746646 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 16:06:27.746933 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:06:27.746728 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls podName:a1ec37ae-7ff5-450e-be11-110cd92c71ad nodeName:}" failed. No retries permitted until 2026-07-09 16:08:29.746710482 +0000 UTC m=+286.818306412 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls") pod "dns-default-ntv5m" (UID: "a1ec37ae-7ff5-450e-be11-110cd92c71ad") : secret "dns-default-metrics-tls" not found Jul 09 16:06:27.746933 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:06:27.746656 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67ddb9dcfb-dx5pl: secret "image-registry-tls" not found Jul 09 16:06:27.746933 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:06:27.746786 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls podName:111dae17-df4c-4556-adbe-55f1988aa74c nodeName:}" failed. No retries permitted until 2026-07-09 16:08:29.746773337 +0000 UTC m=+286.818369265 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls") pod "image-registry-67ddb9dcfb-dx5pl" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c") : secret "image-registry-tls" not found Jul 09 16:06:37.506204 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:06:37.506118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:07:51.055060 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.055024 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l"] Jul 09 16:07:51.057871 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.057856 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-msxnv"] Jul 09 16:07:51.058002 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.057984 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:07:51.060324 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.060306 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg"] Jul 09 16:07:51.060440 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.060407 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-msxnv" Jul 09 16:07:51.061243 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.061225 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:07:51.061331 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.061267 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 16:07:51.061534 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.061517 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 16:07:51.062200 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.062183 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qpwzj\"" Jul 09 16:07:51.062805 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.062790 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:51.065259 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.065245 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tcrjw\"" Jul 09 16:07:51.070971 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.070806 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 16:07:51.070971 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.070836 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 16:07:51.070971 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.070889 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 16:07:51.071203 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.071007 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 16:07:51.071500 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.071460 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9rkfd\"" Jul 09 16:07:51.087089 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.087063 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg"] Jul 09 16:07:51.088293 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.088275 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l"] Jul 09 16:07:51.112005 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.111981 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-27c27"] Jul 09 16:07:51.114974 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.114954 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-msxnv"] Jul 09 16:07:51.115087 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.115037 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.122852 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.122832 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rxskh\"" Jul 09 16:07:51.122949 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.122836 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 16:07:51.123625 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.123609 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 16:07:51.132064 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.132045 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 16:07:51.133280 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.133261 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-27c27"] Jul 09 16:07:51.133422 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.133404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xlg2l\" (UID: \"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:07:51.133459 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.133449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:51.133530 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.133517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jmr6\" (UniqueName: \"kubernetes.io/projected/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-kube-api-access-8jmr6\") pod \"cluster-samples-operator-65db858894-xlg2l\" (UID: \"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:07:51.133567 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.133547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtfl2\" (UniqueName: \"kubernetes.io/projected/8f9b9a0f-656c-439b-ad20-76cc35d86298-kube-api-access-vtfl2\") pod \"network-check-source-869dcfcdcd-msxnv\" (UID: \"8f9b9a0f-656c-439b-ad20-76cc35d86298\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-msxnv" Jul 09 16:07:51.133643 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.133623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z5w7\" (UniqueName: \"kubernetes.io/projected/cef16270-fc30-4eac-b745-b531892da6c4-kube-api-access-7z5w7\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:51.133683 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.133658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cef16270-fc30-4eac-b745-b531892da6c4-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:51.138087 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.138073 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 16:07:51.138514 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.138499 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 16:07:51.216442 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.216405 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ftl8n"] Jul 09 16:07:51.219232 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.219211 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ftl8n" Jul 09 16:07:51.222265 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.222248 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:07:51.222428 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.222416 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 16:07:51.223427 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.223412 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-24fvr\"" Jul 09 16:07:51.234399 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234380 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z5w7\" (UniqueName: \"kubernetes.io/projected/cef16270-fc30-4eac-b745-b531892da6c4-kube-api-access-7z5w7\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:51.234519 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-snapshots\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.234519 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cef16270-fc30-4eac-b745-b531892da6c4-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:51.234519 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-serving-cert\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.234519 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xlg2l\" (UID: \"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:07:51.234735 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.234735 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.234569 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 16:07:51.234735 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-tmp\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.234735 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.234618 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls podName:53603dbe-ed3f-4b8a-92f5-9f6051d16e6a nodeName:}" failed. No retries permitted until 2026-07-09 16:07:51.734603671 +0000 UTC m=+248.806199599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls") pod "cluster-samples-operator-65db858894-xlg2l" (UID: "53603dbe-ed3f-4b8a-92f5-9f6051d16e6a") : secret "samples-operator-tls" not found Jul 09 16:07:51.234735 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:51.234735 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234690 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.235030 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jmr6\" (UniqueName: \"kubernetes.io/projected/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-kube-api-access-8jmr6\") pod \"cluster-samples-operator-65db858894-xlg2l\" (UID: \"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:07:51.235030 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqbzk\" (UniqueName: \"kubernetes.io/projected/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-kube-api-access-hqbzk\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.235030 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.234780 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 16:07:51.235030 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.234800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtfl2\" (UniqueName: \"kubernetes.io/projected/8f9b9a0f-656c-439b-ad20-76cc35d86298-kube-api-access-vtfl2\") pod \"network-check-source-869dcfcdcd-msxnv\" (UID: \"8f9b9a0f-656c-439b-ad20-76cc35d86298\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-msxnv" Jul 09 16:07:51.235030 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.234839 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls podName:cef16270-fc30-4eac-b745-b531892da6c4 nodeName:}" failed. No retries permitted until 2026-07-09 16:07:51.734824613 +0000 UTC m=+248.806420542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2qnkg" (UID: "cef16270-fc30-4eac-b745-b531892da6c4") : secret "cluster-monitoring-operator-tls" not found Jul 09 16:07:51.235692 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.235675 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cef16270-fc30-4eac-b745-b531892da6c4-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:51.246013 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.245987 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt"] Jul 09 16:07:51.249099 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.249083 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-549fd"] Jul 09 16:07:51.249228 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.249213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" Jul 09 16:07:51.251806 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.251789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:07:51.257195 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.257173 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 16:07:51.257325 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.257302 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rhd6j\"" Jul 09 16:07:51.257528 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.257513 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 16:07:51.257852 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.257831 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 16:07:51.257965 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.257852 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 16:07:51.258078 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.258063 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 16:07:51.258364 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.258344 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ftl8n"] Jul 09 16:07:51.258496 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.258452 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mq65v\"" Jul 09 16:07:51.265917 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.265899 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:07:51.275655 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.275630 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jmr6\" (UniqueName: \"kubernetes.io/projected/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-kube-api-access-8jmr6\") pod \"cluster-samples-operator-65db858894-xlg2l\" (UID: \"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:07:51.275749 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.275729 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z5w7\" (UniqueName: \"kubernetes.io/projected/cef16270-fc30-4eac-b745-b531892da6c4-kube-api-access-7z5w7\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:51.291129 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.291096 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtfl2\" (UniqueName: \"kubernetes.io/projected/8f9b9a0f-656c-439b-ad20-76cc35d86298-kube-api-access-vtfl2\") pod \"network-check-source-869dcfcdcd-msxnv\" (UID: \"8f9b9a0f-656c-439b-ad20-76cc35d86298\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-msxnv" Jul 09 16:07:51.292262 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.292233 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-549fd"] Jul 09 16:07:51.293581 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.293558 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt"] Jul 09 16:07:51.335149 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e80700fa-9145-499b-b127-97147a7266cd-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-vbzdt\" (UID: \"e80700fa-9145-499b-b127-97147a7266cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" Jul 09 16:07:51.335149 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk5zt\" (UniqueName: \"kubernetes.io/projected/e80700fa-9145-499b-b127-97147a7266cd-kube-api-access-dk5zt\") pod \"kube-storage-version-migrator-operator-799cb7f958-vbzdt\" (UID: \"e80700fa-9145-499b-b127-97147a7266cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" Jul 09 16:07:51.335346 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-tmp\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.335346 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqbzk\" (UniqueName: \"kubernetes.io/projected/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-kube-api-access-hqbzk\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.335346 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e80700fa-9145-499b-b127-97147a7266cd-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-vbzdt\" (UID: \"e80700fa-9145-499b-b127-97147a7266cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" Jul 09 16:07:51.335346 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335311 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rckzj\" (UniqueName: \"kubernetes.io/projected/57d1a803-58e0-4391-9205-aafad12dcd46-kube-api-access-rckzj\") pod \"volume-data-source-validator-78495597f6-ftl8n\" (UID: \"57d1a803-58e0-4391-9205-aafad12dcd46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ftl8n" Jul 09 16:07:51.335563 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-549fd\" (UID: \"dc844496-f8de-49e9-90fe-dee1f807df44\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:07:51.335563 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc844496-f8de-49e9-90fe-dee1f807df44-nginx-conf\") pod \"networking-console-plugin-6cf856758c-549fd\" (UID: \"dc844496-f8de-49e9-90fe-dee1f807df44\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:07:51.335563 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-snapshots\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.335563 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.335563 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-serving-cert\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.335563 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335545 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-tmp\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.335860 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.335575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.336057 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.336031 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.336057 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.336050 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-snapshots\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.336390 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.336372 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.337950 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.337931 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-serving-cert\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.349659 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.349637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqbzk\" (UniqueName: \"kubernetes.io/projected/9f07b5b8-474a-4cb0-98d2-62d11e08dfde-kube-api-access-hqbzk\") pod \"insights-operator-68d9dd94cf-27c27\" (UID: \"9f07b5b8-474a-4cb0-98d2-62d11e08dfde\") " pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.374657 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.374614 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-msxnv" Jul 09 16:07:51.422941 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.422901 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-27c27" Jul 09 16:07:51.436598 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.436573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e80700fa-9145-499b-b127-97147a7266cd-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-vbzdt\" (UID: \"e80700fa-9145-499b-b127-97147a7266cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" Jul 09 16:07:51.436721 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.436656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk5zt\" (UniqueName: \"kubernetes.io/projected/e80700fa-9145-499b-b127-97147a7266cd-kube-api-access-dk5zt\") pod \"kube-storage-version-migrator-operator-799cb7f958-vbzdt\" (UID: \"e80700fa-9145-499b-b127-97147a7266cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" Jul 09 16:07:51.436721 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.436700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e80700fa-9145-499b-b127-97147a7266cd-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-vbzdt\" (UID: \"e80700fa-9145-499b-b127-97147a7266cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" Jul 09 16:07:51.436882 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.436727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rckzj\" (UniqueName: \"kubernetes.io/projected/57d1a803-58e0-4391-9205-aafad12dcd46-kube-api-access-rckzj\") pod \"volume-data-source-validator-78495597f6-ftl8n\" (UID: \"57d1a803-58e0-4391-9205-aafad12dcd46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ftl8n" Jul 09 16:07:51.436882 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.436765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-549fd\" (UID: \"dc844496-f8de-49e9-90fe-dee1f807df44\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:07:51.436882 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.436799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc844496-f8de-49e9-90fe-dee1f807df44-nginx-conf\") pod \"networking-console-plugin-6cf856758c-549fd\" (UID: \"dc844496-f8de-49e9-90fe-dee1f807df44\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:07:51.437662 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.437562 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc844496-f8de-49e9-90fe-dee1f807df44-nginx-conf\") pod \"networking-console-plugin-6cf856758c-549fd\" (UID: \"dc844496-f8de-49e9-90fe-dee1f807df44\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:07:51.437662 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.437624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e80700fa-9145-499b-b127-97147a7266cd-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-vbzdt\" (UID: \"e80700fa-9145-499b-b127-97147a7266cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" Jul 09 16:07:51.437818 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.437664 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 16:07:51.437818 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.437726 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert podName:dc844496-f8de-49e9-90fe-dee1f807df44 nodeName:}" failed. No retries permitted until 2026-07-09 16:07:51.93770734 +0000 UTC m=+249.009303282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-549fd" (UID: "dc844496-f8de-49e9-90fe-dee1f807df44") : secret "networking-console-plugin-cert" not found Jul 09 16:07:51.440307 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.440287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e80700fa-9145-499b-b127-97147a7266cd-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-vbzdt\" (UID: \"e80700fa-9145-499b-b127-97147a7266cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" Jul 09 16:07:51.447794 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.447772 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk5zt\" (UniqueName: \"kubernetes.io/projected/e80700fa-9145-499b-b127-97147a7266cd-kube-api-access-dk5zt\") pod \"kube-storage-version-migrator-operator-799cb7f958-vbzdt\" (UID: \"e80700fa-9145-499b-b127-97147a7266cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" Jul 09 16:07:51.447879 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.447823 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rckzj\" (UniqueName: \"kubernetes.io/projected/57d1a803-58e0-4391-9205-aafad12dcd46-kube-api-access-rckzj\") pod \"volume-data-source-validator-78495597f6-ftl8n\" (UID: \"57d1a803-58e0-4391-9205-aafad12dcd46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ftl8n" Jul 09 16:07:51.521209 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:07:51.521175 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9b9a0f_656c_439b_ad20_76cc35d86298.slice/crio-5035e4771e5f15c54ddf96277a7f4c1eaf3f1adbe0f44c571e1a9ad6468b9f0a WatchSource:0}: Error finding container 5035e4771e5f15c54ddf96277a7f4c1eaf3f1adbe0f44c571e1a9ad6468b9f0a: Status 404 returned error can't find the container with id 5035e4771e5f15c54ddf96277a7f4c1eaf3f1adbe0f44c571e1a9ad6468b9f0a Jul 09 16:07:51.526053 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.525866 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-msxnv"] Jul 09 16:07:51.527675 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.527654 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ftl8n" Jul 09 16:07:51.558815 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.558793 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" Jul 09 16:07:51.565682 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.565628 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-27c27"] Jul 09 16:07:51.568065 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:07:51.567928 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f07b5b8_474a_4cb0_98d2_62d11e08dfde.slice/crio-f1f74f4751cee8f12cc4b0cccb251b91aa367d34df3a62f2b85bb1868caab65d WatchSource:0}: Error finding container f1f74f4751cee8f12cc4b0cccb251b91aa367d34df3a62f2b85bb1868caab65d: Status 404 returned error can't find the container with id f1f74f4751cee8f12cc4b0cccb251b91aa367d34df3a62f2b85bb1868caab65d Jul 09 16:07:51.678800 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.678768 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ftl8n"] Jul 09 16:07:51.681714 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:07:51.681683 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d1a803_58e0_4391_9205_aafad12dcd46.slice/crio-7ffb72b44b42e156bfec1aecb35390724dd1a1839c720d36cee620640066a545 WatchSource:0}: Error finding container 7ffb72b44b42e156bfec1aecb35390724dd1a1839c720d36cee620640066a545: Status 404 returned error can't find the container with id 7ffb72b44b42e156bfec1aecb35390724dd1a1839c720d36cee620640066a545 Jul 09 16:07:51.695822 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.695799 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt"] Jul 09 16:07:51.698767 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:07:51.698744 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80700fa_9145_499b_b127_97147a7266cd.slice/crio-27e070e190e76b780bd432f1f589889ea59f72f80bfd695af32f346eb4c3eb62 WatchSource:0}: Error finding container 27e070e190e76b780bd432f1f589889ea59f72f80bfd695af32f346eb4c3eb62: Status 404 returned error can't find the container with id 27e070e190e76b780bd432f1f589889ea59f72f80bfd695af32f346eb4c3eb62 Jul 09 16:07:51.740103 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.740072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xlg2l\" (UID: \"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:07:51.740237 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.740179 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:51.740237 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.740228 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 16:07:51.740350 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.740283 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 16:07:51.740350 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.740290 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls podName:53603dbe-ed3f-4b8a-92f5-9f6051d16e6a nodeName:}" failed. No retries permitted until 2026-07-09 16:07:52.740273088 +0000 UTC m=+249.811869039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls") pod "cluster-samples-operator-65db858894-xlg2l" (UID: "53603dbe-ed3f-4b8a-92f5-9f6051d16e6a") : secret "samples-operator-tls" not found Jul 09 16:07:51.740350 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.740319 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls podName:cef16270-fc30-4eac-b745-b531892da6c4 nodeName:}" failed. No retries permitted until 2026-07-09 16:07:52.740309704 +0000 UTC m=+249.811905634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2qnkg" (UID: "cef16270-fc30-4eac-b745-b531892da6c4") : secret "cluster-monitoring-operator-tls" not found Jul 09 16:07:51.941808 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:51.941715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-549fd\" (UID: \"dc844496-f8de-49e9-90fe-dee1f807df44\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:07:51.941972 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.941869 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 16:07:51.941972 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:51.941934 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert podName:dc844496-f8de-49e9-90fe-dee1f807df44 nodeName:}" failed. No retries permitted until 2026-07-09 16:07:52.941918614 +0000 UTC m=+250.013514541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-549fd" (UID: "dc844496-f8de-49e9-90fe-dee1f807df44") : secret "networking-console-plugin-cert" not found Jul 09 16:07:52.202277 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:52.202180 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ftl8n" event={"ID":"57d1a803-58e0-4391-9205-aafad12dcd46","Type":"ContainerStarted","Data":"7ffb72b44b42e156bfec1aecb35390724dd1a1839c720d36cee620640066a545"} Jul 09 16:07:52.208668 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:52.208503 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-msxnv" event={"ID":"8f9b9a0f-656c-439b-ad20-76cc35d86298","Type":"ContainerStarted","Data":"a8151c0ac77aa12b2708e2479d22f32a3fa7f975c9a28668238c254de705b843"} Jul 09 16:07:52.208668 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:52.208591 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-msxnv" event={"ID":"8f9b9a0f-656c-439b-ad20-76cc35d86298","Type":"ContainerStarted","Data":"5035e4771e5f15c54ddf96277a7f4c1eaf3f1adbe0f44c571e1a9ad6468b9f0a"} Jul 09 16:07:52.210055 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:52.210023 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" event={"ID":"e80700fa-9145-499b-b127-97147a7266cd","Type":"ContainerStarted","Data":"27e070e190e76b780bd432f1f589889ea59f72f80bfd695af32f346eb4c3eb62"} Jul 09 16:07:52.211363 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:52.211339 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-27c27" event={"ID":"9f07b5b8-474a-4cb0-98d2-62d11e08dfde","Type":"ContainerStarted","Data":"f1f74f4751cee8f12cc4b0cccb251b91aa367d34df3a62f2b85bb1868caab65d"} Jul 09 16:07:52.226612 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:52.226566 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-msxnv" podStartSLOduration=2.226548125 podStartE2EDuration="2.226548125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:07:52.226133676 +0000 UTC m=+249.297729624" watchObservedRunningTime="2026-07-09 16:07:52.226548125 +0000 UTC m=+249.298144078" Jul 09 16:07:52.748075 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:52.748033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xlg2l\" (UID: \"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:07:52.748280 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:52.748171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:52.748280 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:52.748245 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 16:07:52.748280 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:52.748270 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 16:07:52.748390 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:52.748324 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls podName:53603dbe-ed3f-4b8a-92f5-9f6051d16e6a nodeName:}" failed. No retries permitted until 2026-07-09 16:07:54.748304638 +0000 UTC m=+251.819900586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls") pod "cluster-samples-operator-65db858894-xlg2l" (UID: "53603dbe-ed3f-4b8a-92f5-9f6051d16e6a") : secret "samples-operator-tls" not found Jul 09 16:07:52.748390 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:52.748345 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls podName:cef16270-fc30-4eac-b745-b531892da6c4 nodeName:}" failed. No retries permitted until 2026-07-09 16:07:54.748334157 +0000 UTC m=+251.819930090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2qnkg" (UID: "cef16270-fc30-4eac-b745-b531892da6c4") : secret "cluster-monitoring-operator-tls" not found Jul 09 16:07:52.949783 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:52.949739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-549fd\" (UID: \"dc844496-f8de-49e9-90fe-dee1f807df44\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:07:52.949955 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:52.949934 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 16:07:52.950023 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:52.950013 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert podName:dc844496-f8de-49e9-90fe-dee1f807df44 nodeName:}" failed. No retries permitted until 2026-07-09 16:07:54.949993837 +0000 UTC m=+252.021589785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-549fd" (UID: "dc844496-f8de-49e9-90fe-dee1f807df44") : secret "networking-console-plugin-cert" not found Jul 09 16:07:53.216525 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:53.216482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ftl8n" event={"ID":"57d1a803-58e0-4391-9205-aafad12dcd46","Type":"ContainerStarted","Data":"6cc67c0cc1f53d1c094ff61be22a752b1ebeb1af066e013577b28a4037f8424f"} Jul 09 16:07:53.232007 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:53.231926 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ftl8n" podStartSLOduration=1.085843122 podStartE2EDuration="2.231904567s" totalImagesPullingTime="1.146061445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:07:53.231280979 +0000 UTC m=+250.302876929" watchObservedRunningTime="2026-07-09 16:07:53.231904567 +0000 UTC m=+250.303500517" Jul 09 16:07:54.765871 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:54.765773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xlg2l\" (UID: \"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:07:54.766211 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:54.765906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:54.766211 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:54.765933 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 16:07:54.766211 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:54.766000 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls podName:53603dbe-ed3f-4b8a-92f5-9f6051d16e6a nodeName:}" failed. No retries permitted until 2026-07-09 16:07:58.765984443 +0000 UTC m=+255.837580371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls") pod "cluster-samples-operator-65db858894-xlg2l" (UID: "53603dbe-ed3f-4b8a-92f5-9f6051d16e6a") : secret "samples-operator-tls" not found Jul 09 16:07:54.766211 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:54.766024 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 16:07:54.766211 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:54.766076 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls podName:cef16270-fc30-4eac-b745-b531892da6c4 nodeName:}" failed. No retries permitted until 2026-07-09 16:07:58.766060971 +0000 UTC m=+255.837656905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2qnkg" (UID: "cef16270-fc30-4eac-b745-b531892da6c4") : secret "cluster-monitoring-operator-tls" not found Jul 09 16:07:54.967901 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:54.967865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-549fd\" (UID: \"dc844496-f8de-49e9-90fe-dee1f807df44\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:07:54.968060 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:54.968039 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 16:07:54.968131 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:54.968120 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert podName:dc844496-f8de-49e9-90fe-dee1f807df44 nodeName:}" failed. No retries permitted until 2026-07-09 16:07:58.968100391 +0000 UTC m=+256.039696325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-549fd" (UID: "dc844496-f8de-49e9-90fe-dee1f807df44") : secret "networking-console-plugin-cert" not found Jul 09 16:07:55.224902 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.224865 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" event={"ID":"e80700fa-9145-499b-b127-97147a7266cd","Type":"ContainerStarted","Data":"e362ee8598364df37620b59d4e4828419937a7903036115112d8ac4a9d9085de"} Jul 09 16:07:55.226560 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.226525 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-27c27" event={"ID":"9f07b5b8-474a-4cb0-98d2-62d11e08dfde","Type":"ContainerStarted","Data":"75cffc42785f3a1ced7006b2bb13f244da1ea4384762d83c92f2056ff09cc2b2"} Jul 09 16:07:55.240382 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.240328 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" podStartSLOduration=1.479358508 podStartE2EDuration="4.240309779s" totalImagesPullingTime="2.760951271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:07:55.240031763 +0000 UTC m=+252.311627727" watchObservedRunningTime="2026-07-09 16:07:55.240309779 +0000 UTC m=+252.311905727" Jul 09 16:07:55.266270 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.266053 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-27c27" podStartSLOduration=1.378468144 podStartE2EDuration="4.266028809s" totalImagesPullingTime="2.887560665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:07:55.258623556 +0000 UTC m=+252.330219509" watchObservedRunningTime="2026-07-09 16:07:55.266028809 +0000 UTC m=+252.337624760" Jul 09 16:07:55.271298 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.271266 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:07:55.271448 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:55.271413 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 16:07:55.271537 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:55.271507 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs podName:865c284a-ea51-4053-9d3e-32524736479b nodeName:}" failed. No retries permitted until 2026-07-09 16:09:57.271484669 +0000 UTC m=+374.343080611 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs") pod "network-metrics-daemon-k74h8" (UID: "865c284a-ea51-4053-9d3e-32524736479b") : secret "metrics-daemon-secret" not found Jul 09 16:07:55.792952 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.792921 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fwcrs"] Jul 09 16:07:55.796268 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.796240 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.798890 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.798864 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 16:07:55.799041 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.798947 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hnt4w\"" Jul 09 16:07:55.799041 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.798981 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 16:07:55.806689 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.806670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fwcrs"] Jul 09 16:07:55.878384 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.878344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48jt6\" (UniqueName: \"kubernetes.io/projected/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-api-access-48jt6\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.878560 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.878497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.878560 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.878544 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/55d7fdee-5503-4979-8106-92ff9288a1ea-crio-socket\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.878640 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.878568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.878640 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.878612 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d7fdee-5503-4979-8106-92ff9288a1ea-data-volume\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.979703 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.979665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d7fdee-5503-4979-8106-92ff9288a1ea-data-volume\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.979888 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.979712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48jt6\" (UniqueName: \"kubernetes.io/projected/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-api-access-48jt6\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.979888 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.979759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.979888 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.979871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/55d7fdee-5503-4979-8106-92ff9288a1ea-crio-socket\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.980049 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:55.979896 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 16:07:55.980049 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:55.979949 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 16:07:55.980049 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:55.979984 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls podName:55d7fdee-5503-4979-8106-92ff9288a1ea nodeName:}" failed. No retries permitted until 2026-07-09 16:07:56.479963031 +0000 UTC m=+253.551558974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fwcrs" (UID: "55d7fdee-5503-4979-8106-92ff9288a1ea") : secret "insights-runtime-extractor-tls" not found Jul 09 16:07:55.980049 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.979904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.980049 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.979995 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/55d7fdee-5503-4979-8106-92ff9288a1ea-crio-socket\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.980049 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:55.980005 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm podName:55d7fdee-5503-4979-8106-92ff9288a1ea nodeName:}" failed. No retries permitted until 2026-07-09 16:07:56.479994907 +0000 UTC m=+253.551590838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fwcrs" (UID: "55d7fdee-5503-4979-8106-92ff9288a1ea") : configmap "kube-rbac-proxy" not found Jul 09 16:07:55.980251 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.980079 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d7fdee-5503-4979-8106-92ff9288a1ea-data-volume\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:55.988359 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:55.988333 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48jt6\" (UniqueName: \"kubernetes.io/projected/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-api-access-48jt6\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:56.304648 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.304620 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd"] Jul 09 16:07:56.307358 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.307340 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd" Jul 09 16:07:56.310177 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.310158 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 16:07:56.310331 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.310309 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 16:07:56.310457 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.310377 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zj968\"" Jul 09 16:07:56.317874 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.317848 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd"] Jul 09 16:07:56.383762 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.383722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq2tg\" (UniqueName: \"kubernetes.io/projected/8dd22956-4f69-4ebd-932f-55be2e83048d-kube-api-access-nq2tg\") pod \"migrator-7f59b54f6c-hzcbd\" (UID: \"8dd22956-4f69-4ebd-932f-55be2e83048d\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd" Jul 09 16:07:56.485410 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.485378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:56.485410 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.485417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq2tg\" (UniqueName: \"kubernetes.io/projected/8dd22956-4f69-4ebd-932f-55be2e83048d-kube-api-access-nq2tg\") pod \"migrator-7f59b54f6c-hzcbd\" (UID: \"8dd22956-4f69-4ebd-932f-55be2e83048d\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd" Jul 09 16:07:56.485666 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.485515 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:56.485666 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:56.485548 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 16:07:56.485666 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:56.485594 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 16:07:56.485666 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:56.485612 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm podName:55d7fdee-5503-4979-8106-92ff9288a1ea nodeName:}" failed. No retries permitted until 2026-07-09 16:07:57.485591579 +0000 UTC m=+254.557187531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fwcrs" (UID: "55d7fdee-5503-4979-8106-92ff9288a1ea") : configmap "kube-rbac-proxy" not found Jul 09 16:07:56.485666 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:56.485648 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls podName:55d7fdee-5503-4979-8106-92ff9288a1ea nodeName:}" failed. No retries permitted until 2026-07-09 16:07:57.485633941 +0000 UTC m=+254.557229894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fwcrs" (UID: "55d7fdee-5503-4979-8106-92ff9288a1ea") : secret "insights-runtime-extractor-tls" not found Jul 09 16:07:56.493600 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.493575 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq2tg\" (UniqueName: \"kubernetes.io/projected/8dd22956-4f69-4ebd-932f-55be2e83048d-kube-api-access-nq2tg\") pod \"migrator-7f59b54f6c-hzcbd\" (UID: \"8dd22956-4f69-4ebd-932f-55be2e83048d\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd" Jul 09 16:07:56.616868 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.616844 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd" Jul 09 16:07:56.741451 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:56.741420 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd"] Jul 09 16:07:56.744455 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:07:56.744427 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd22956_4f69_4ebd_932f_55be2e83048d.slice/crio-412a56ae77194942b81f10ec93620aca681d3d48c2f05dd4b1962aa960da6bcd WatchSource:0}: Error finding container 412a56ae77194942b81f10ec93620aca681d3d48c2f05dd4b1962aa960da6bcd: Status 404 returned error can't find the container with id 412a56ae77194942b81f10ec93620aca681d3d48c2f05dd4b1962aa960da6bcd Jul 09 16:07:57.234282 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:57.234243 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd" event={"ID":"8dd22956-4f69-4ebd-932f-55be2e83048d","Type":"ContainerStarted","Data":"412a56ae77194942b81f10ec93620aca681d3d48c2f05dd4b1962aa960da6bcd"} Jul 09 16:07:57.495393 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:57.495298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:57.495393 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:57.495354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:57.495615 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:57.495488 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 16:07:57.495615 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:57.495495 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 16:07:57.495615 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:57.495546 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm podName:55d7fdee-5503-4979-8106-92ff9288a1ea nodeName:}" failed. No retries permitted until 2026-07-09 16:07:59.495530473 +0000 UTC m=+256.567126408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fwcrs" (UID: "55d7fdee-5503-4979-8106-92ff9288a1ea") : configmap "kube-rbac-proxy" not found Jul 09 16:07:57.495615 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:57.495572 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls podName:55d7fdee-5503-4979-8106-92ff9288a1ea nodeName:}" failed. No retries permitted until 2026-07-09 16:07:59.49555287 +0000 UTC m=+256.567148801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fwcrs" (UID: "55d7fdee-5503-4979-8106-92ff9288a1ea") : secret "insights-runtime-extractor-tls" not found Jul 09 16:07:57.579977 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:57.579944 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8nqhq_eef619ed-c5fa-4806-ba7f-c1799b636cc0/dns-node-resolver/0.log" Jul 09 16:07:58.238872 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:58.238841 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd" event={"ID":"8dd22956-4f69-4ebd-932f-55be2e83048d","Type":"ContainerStarted","Data":"621b05927c49710aeb9471e62a110031b988d62fb70f4c3660f92aab95126a85"} Jul 09 16:07:58.780591 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:58.780559 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hn2fx_f91294fb-ac44-48d8-a7b2-fbb8941bbce9/node-ca/0.log" Jul 09 16:07:58.806991 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:58.806962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:07:58.807156 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:58.807015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xlg2l\" (UID: \"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:07:58.807156 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:58.807130 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 16:07:58.807156 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:58.807142 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 16:07:58.807281 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:58.807201 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls podName:53603dbe-ed3f-4b8a-92f5-9f6051d16e6a nodeName:}" failed. No retries permitted until 2026-07-09 16:08:06.807184537 +0000 UTC m=+263.878780468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls") pod "cluster-samples-operator-65db858894-xlg2l" (UID: "53603dbe-ed3f-4b8a-92f5-9f6051d16e6a") : secret "samples-operator-tls" not found Jul 09 16:07:58.807281 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:58.807216 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls podName:cef16270-fc30-4eac-b745-b531892da6c4 nodeName:}" failed. No retries permitted until 2026-07-09 16:08:06.807208575 +0000 UTC m=+263.878804503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2qnkg" (UID: "cef16270-fc30-4eac-b745-b531892da6c4") : secret "cluster-monitoring-operator-tls" not found Jul 09 16:07:59.008492 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:59.008429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-549fd\" (UID: \"dc844496-f8de-49e9-90fe-dee1f807df44\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:07:59.008681 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:59.008608 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 16:07:59.008681 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:59.008681 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert podName:dc844496-f8de-49e9-90fe-dee1f807df44 nodeName:}" failed. No retries permitted until 2026-07-09 16:08:07.008664795 +0000 UTC m=+264.080260724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-549fd" (UID: "dc844496-f8de-49e9-90fe-dee1f807df44") : secret "networking-console-plugin-cert" not found Jul 09 16:07:59.243241 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:59.243202 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd" event={"ID":"8dd22956-4f69-4ebd-932f-55be2e83048d","Type":"ContainerStarted","Data":"ff3a675c642bdf5c17b5a1ddd63c049513498d92671f9f4ed9e590c461b78f09"} Jul 09 16:07:59.265189 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:59.265141 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hzcbd" podStartSLOduration=1.864519676 podStartE2EDuration="3.265125428s" totalImagesPullingTime="1.400605752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:07:59.262775749 +0000 UTC m=+256.334371716" watchObservedRunningTime="2026-07-09 16:07:59.265125428 +0000 UTC m=+256.336721378" Jul 09 16:07:59.513428 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:59.513353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:59.513428 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:59.513398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:07:59.513620 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:59.513517 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 16:07:59.513620 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:59.513518 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 16:07:59.513620 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:59.513566 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm podName:55d7fdee-5503-4979-8106-92ff9288a1ea nodeName:}" failed. No retries permitted until 2026-07-09 16:08:03.51355349 +0000 UTC m=+260.585149417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fwcrs" (UID: "55d7fdee-5503-4979-8106-92ff9288a1ea") : configmap "kube-rbac-proxy" not found Jul 09 16:07:59.513620 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:07:59.513578 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls podName:55d7fdee-5503-4979-8106-92ff9288a1ea nodeName:}" failed. No retries permitted until 2026-07-09 16:08:03.513572244 +0000 UTC m=+260.585168172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fwcrs" (UID: "55d7fdee-5503-4979-8106-92ff9288a1ea") : secret "insights-runtime-extractor-tls" not found Jul 09 16:07:59.781848 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:07:59.781778 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rpd2k_62121c21-50ff-4149-80f8-9fcbd30865d4/serve-healthcheck-canary/0.log" Jul 09 16:08:03.547909 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:03.547871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:08:03.548346 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:03.547938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:08:03.548346 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:08:03.548045 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 16:08:03.548346 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:08:03.548056 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 16:08:03.548346 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:08:03.548115 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm podName:55d7fdee-5503-4979-8106-92ff9288a1ea nodeName:}" failed. No retries permitted until 2026-07-09 16:08:11.548096756 +0000 UTC m=+268.619692708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fwcrs" (UID: "55d7fdee-5503-4979-8106-92ff9288a1ea") : configmap "kube-rbac-proxy" not found Jul 09 16:08:03.548346 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:08:03.548133 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls podName:55d7fdee-5503-4979-8106-92ff9288a1ea nodeName:}" failed. No retries permitted until 2026-07-09 16:08:11.548123634 +0000 UTC m=+268.619719566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fwcrs" (UID: "55d7fdee-5503-4979-8106-92ff9288a1ea") : secret "insights-runtime-extractor-tls" not found Jul 09 16:08:06.873123 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:06.873039 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:08:06.873123 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:06.873099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xlg2l\" (UID: \"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:08:06.875924 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:06.875902 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/53603dbe-ed3f-4b8a-92f5-9f6051d16e6a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xlg2l\" (UID: \"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:08:06.876002 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:06.875968 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cef16270-fc30-4eac-b745-b531892da6c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2qnkg\" (UID: \"cef16270-fc30-4eac-b745-b531892da6c4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:08:06.968396 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:06.968360 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" Jul 09 16:08:06.979552 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:06.979524 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" Jul 09 16:08:07.074167 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:07.074139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-549fd\" (UID: \"dc844496-f8de-49e9-90fe-dee1f807df44\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:08:07.076679 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:07.076655 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc844496-f8de-49e9-90fe-dee1f807df44-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-549fd\" (UID: \"dc844496-f8de-49e9-90fe-dee1f807df44\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:08:07.108434 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:07.108404 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l"] Jul 09 16:08:07.123423 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:07.123378 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg"] Jul 09 16:08:07.125442 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:07.125416 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef16270_fc30_4eac_b745_b531892da6c4.slice/crio-b7a8bd84051369a3df15bb28e4d3d243f750aeafed7af6a70d9ee51c7a5b204b WatchSource:0}: Error finding container b7a8bd84051369a3df15bb28e4d3d243f750aeafed7af6a70d9ee51c7a5b204b: Status 404 returned error can't find the container with id b7a8bd84051369a3df15bb28e4d3d243f750aeafed7af6a70d9ee51c7a5b204b Jul 09 16:08:07.164409 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:07.164391 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" Jul 09 16:08:07.270457 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:07.270425 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" event={"ID":"cef16270-fc30-4eac-b745-b531892da6c4","Type":"ContainerStarted","Data":"b7a8bd84051369a3df15bb28e4d3d243f750aeafed7af6a70d9ee51c7a5b204b"} Jul 09 16:08:07.271591 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:07.271563 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" event={"ID":"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a","Type":"ContainerStarted","Data":"f0cf7225658083c6035067d7e1a3a8581ec4a602afa537ded3a36ed871f388ef"} Jul 09 16:08:07.296266 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:07.296238 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-549fd"] Jul 09 16:08:07.299045 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:07.299020 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc844496_f8de_49e9_90fe_dee1f807df44.slice/crio-32e2bcbd11198605dd05cc8fb5ca7b3ad3049aa388c901ba78311008ffafe1c8 WatchSource:0}: Error finding container 32e2bcbd11198605dd05cc8fb5ca7b3ad3049aa388c901ba78311008ffafe1c8: Status 404 returned error can't find the container with id 32e2bcbd11198605dd05cc8fb5ca7b3ad3049aa388c901ba78311008ffafe1c8 Jul 09 16:08:08.277432 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:08.277390 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" event={"ID":"dc844496-f8de-49e9-90fe-dee1f807df44","Type":"ContainerStarted","Data":"32e2bcbd11198605dd05cc8fb5ca7b3ad3049aa388c901ba78311008ffafe1c8"} Jul 09 16:08:09.283921 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:09.283884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" event={"ID":"dc844496-f8de-49e9-90fe-dee1f807df44","Type":"ContainerStarted","Data":"bbfe425315f179fe0e311340801d9d1637f792b8ba2788e5c8ecec8886867790"} Jul 09 16:08:09.302443 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:09.302387 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-549fd" podStartSLOduration=17.098623061 podStartE2EDuration="18.302369799s" totalImagesPullingTime="1.203746738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:09.300579318 +0000 UTC m=+266.372175267" watchObservedRunningTime="2026-07-09 16:08:09.302369799 +0000 UTC m=+266.373965749" Jul 09 16:08:10.288970 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:10.288871 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" event={"ID":"cef16270-fc30-4eac-b745-b531892da6c4","Type":"ContainerStarted","Data":"5996b941917c711faa2bebf54142bfbbd0f83f9db34d28a70d0eac3b554b9fc5"} Jul 09 16:08:10.290678 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:10.290650 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" event={"ID":"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a","Type":"ContainerStarted","Data":"cb5966e755be2b7d172ee83962693464c2825215ceab0c1786f57b7e5c7767bc"} Jul 09 16:08:10.290807 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:10.290703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" event={"ID":"53603dbe-ed3f-4b8a-92f5-9f6051d16e6a","Type":"ContainerStarted","Data":"bf7b35ca7e3538b42bebac5654621a7d9cd2a5665ce252236c73195811873be3"} Jul 09 16:08:10.306786 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:10.306730 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2qnkg" podStartSLOduration=17.486331752 podStartE2EDuration="20.306714203s" totalImagesPullingTime="2.820382451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:10.305747351 +0000 UTC m=+267.377343305" watchObservedRunningTime="2026-07-09 16:08:10.306714203 +0000 UTC m=+267.378310153" Jul 09 16:08:10.324005 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:10.323956 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xlg2l" podStartSLOduration=17.533349287 podStartE2EDuration="20.323938178s" totalImagesPullingTime="2.790588891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:10.322680314 +0000 UTC m=+267.394276261" watchObservedRunningTime="2026-07-09 16:08:10.323938178 +0000 UTC m=+267.395534128" Jul 09 16:08:11.614692 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:11.614648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:08:11.614692 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:11.614707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:08:11.615172 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:11.615153 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/55d7fdee-5503-4979-8106-92ff9288a1ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:08:11.617083 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:11.617051 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/55d7fdee-5503-4979-8106-92ff9288a1ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwcrs\" (UID: \"55d7fdee-5503-4979-8106-92ff9288a1ea\") " pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:08:11.705867 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:11.705835 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fwcrs" Jul 09 16:08:11.848287 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:11.848257 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fwcrs"] Jul 09 16:08:11.851708 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:11.851684 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d7fdee_5503_4979_8106_92ff9288a1ea.slice/crio-f93ae70d91bb87712fe8da7439b32e03744b300bd9fc79bc4254ac56879daf60 WatchSource:0}: Error finding container f93ae70d91bb87712fe8da7439b32e03744b300bd9fc79bc4254ac56879daf60: Status 404 returned error can't find the container with id f93ae70d91bb87712fe8da7439b32e03744b300bd9fc79bc4254ac56879daf60 Jul 09 16:08:12.298786 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:12.298754 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwcrs" event={"ID":"55d7fdee-5503-4979-8106-92ff9288a1ea","Type":"ContainerStarted","Data":"f93ae70d91bb87712fe8da7439b32e03744b300bd9fc79bc4254ac56879daf60"} Jul 09 16:08:16.314076 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:16.314042 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwcrs" event={"ID":"55d7fdee-5503-4979-8106-92ff9288a1ea","Type":"ContainerStarted","Data":"bf1200bff88ae68a048e593175cb0c9c43da5e4ee5578ed7ce7f3ba646884ae1"} Jul 09 16:08:17.320049 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:17.320004 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwcrs" event={"ID":"55d7fdee-5503-4979-8106-92ff9288a1ea","Type":"ContainerStarted","Data":"3e024f62bee40f5f74ae5e86e56f4b368bf715aa69ed4a34aa72d828916659d7"} Jul 09 16:08:19.331731 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:19.331643 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwcrs" event={"ID":"55d7fdee-5503-4979-8106-92ff9288a1ea","Type":"ContainerStarted","Data":"875c008616856676d4753712bc1373d5222cc882a2cea78994745608bc520236"} Jul 09 16:08:19.354833 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:19.354782 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fwcrs" podStartSLOduration=17.434363066 podStartE2EDuration="24.354765698s" totalImagesPullingTime="6.920402632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:07:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:19.353314307 +0000 UTC m=+276.424910266" watchObservedRunningTime="2026-07-09 16:08:19.354765698 +0000 UTC m=+276.426361647" Jul 09 16:08:21.350353 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:21.350325 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv"] Jul 09 16:08:21.353575 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:21.353552 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv" Jul 09 16:08:21.357542 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:21.357511 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 16:08:21.357656 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:21.357511 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rvbnf\"" Jul 09 16:08:21.364983 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:21.364958 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv"] Jul 09 16:08:21.396705 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:21.396668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/05dbe0ba-0c40-4356-9344-64e57313cc1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-h28nv\" (UID: \"05dbe0ba-0c40-4356-9344-64e57313cc1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv" Jul 09 16:08:21.497737 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:21.497700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/05dbe0ba-0c40-4356-9344-64e57313cc1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-h28nv\" (UID: \"05dbe0ba-0c40-4356-9344-64e57313cc1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv" Jul 09 16:08:21.500187 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:21.500149 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/05dbe0ba-0c40-4356-9344-64e57313cc1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-h28nv\" (UID: \"05dbe0ba-0c40-4356-9344-64e57313cc1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv" Jul 09 16:08:21.664573 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:21.664541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv" Jul 09 16:08:21.793823 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:21.793714 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv"] Jul 09 16:08:21.796197 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:21.796161 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05dbe0ba_0c40_4356_9344_64e57313cc1d.slice/crio-7c1c63f40f9162480028629a14990ea79e92fc96ae20858d540cffec69b3f292 WatchSource:0}: Error finding container 7c1c63f40f9162480028629a14990ea79e92fc96ae20858d540cffec69b3f292: Status 404 returned error can't find the container with id 7c1c63f40f9162480028629a14990ea79e92fc96ae20858d540cffec69b3f292 Jul 09 16:08:22.343418 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:22.343375 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv" event={"ID":"05dbe0ba-0c40-4356-9344-64e57313cc1d","Type":"ContainerStarted","Data":"7c1c63f40f9162480028629a14990ea79e92fc96ae20858d540cffec69b3f292"} Jul 09 16:08:23.348265 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:23.348227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv" event={"ID":"05dbe0ba-0c40-4356-9344-64e57313cc1d","Type":"ContainerStarted","Data":"f5a6c78eb75d801d4ff97655309c0055a6c9e08a9692164151de5a0c54aa7b21"} Jul 09 16:08:23.348718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:23.348414 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv" Jul 09 16:08:23.352908 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:23.352887 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv" Jul 09 16:08:23.364239 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:23.364194 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h28nv" podStartSLOduration=0.968052212 podStartE2EDuration="2.364179224s" totalImagesPullingTime="1.396127012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:23.363268778 +0000 UTC m=+280.434864728" watchObservedRunningTime="2026-07-09 16:08:23.364179224 +0000 UTC m=+280.435775174" Jul 09 16:08:25.990742 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:08:25.990691 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" podUID="111dae17-df4c-4556-adbe-55f1988aa74c" Jul 09 16:08:25.990742 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:08:25.990691 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ntv5m" podUID="a1ec37ae-7ff5-450e-be11-110cd92c71ad" Jul 09 16:08:26.357282 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:26.357187 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntv5m" Jul 09 16:08:26.357282 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:26.357191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:08:27.911918 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.911883 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7"] Jul 09 16:08:27.940363 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.940332 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7"] Jul 09 16:08:27.940531 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.940455 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:27.944880 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.944859 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 16:08:27.946134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.946118 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-clsx5\"" Jul 09 16:08:27.946351 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.946332 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 16:08:27.946404 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.946332 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 16:08:27.969036 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.969006 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-mkjlb"] Jul 09 16:08:27.986453 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.986428 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:27.989649 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.989523 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 16:08:27.989649 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.989533 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 16:08:27.990031 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.990006 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 16:08:27.990141 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.990081 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wdt58\"" Jul 09 16:08:27.991372 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.991354 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-mkjlb"] Jul 09 16:08:27.994890 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:27.994870 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5xzl6"] Jul 09 16:08:28.016591 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.016559 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.021835 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.021812 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 16:08:28.022120 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.022103 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cq2lf\"" Jul 09 16:08:28.022200 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.022184 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 16:08:28.022274 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.022256 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 16:08:28.050163 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.050131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.050289 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.050191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b0f1015-7265-4919-98f3-874caec0fa27-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.050289 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.050222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzlgl\" (UniqueName: \"kubernetes.io/projected/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-kube-api-access-xzlgl\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.050289 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.050249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.050420 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.050278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnvw5\" (UniqueName: \"kubernetes.io/projected/9b0f1015-7265-4919-98f3-874caec0fa27-kube-api-access-qnvw5\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.050420 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.050331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.050420 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.050349 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.050420 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.050388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9b0f1015-7265-4919-98f3-874caec0fa27-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.050564 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.050421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.050564 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.050438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.151626 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.151748 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.151748 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151662 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b712de0b-2e56-4cd4-b06f-ba3a870f2325-metrics-client-ca\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.151748 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-textfile\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.151748 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-wtmp\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.151944 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.151944 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b0f1015-7265-4919-98f3-874caec0fa27-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.151944 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzlgl\" (UniqueName: \"kubernetes.io/projected/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-kube-api-access-xzlgl\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.151944 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.151944 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-tls\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.151944 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnvw5\" (UniqueName: \"kubernetes.io/projected/9b0f1015-7265-4919-98f3-874caec0fa27-kube-api-access-qnvw5\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.152228 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.151977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.152228 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:08:28.152003 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 16:08:28.152228 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:08:28.152084 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-tls podName:9b0f1015-7265-4919-98f3-874caec0fa27 nodeName:}" failed. No retries permitted until 2026-07-09 16:08:28.652063491 +0000 UTC m=+285.723659423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-mkjlb" (UID: "9b0f1015-7265-4919-98f3-874caec0fa27") : secret "kube-state-metrics-tls" not found Jul 09 16:08:28.152228 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.152002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.152425 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.152240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.152425 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.152279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9b0f1015-7265-4919-98f3-874caec0fa27-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.152425 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.152397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b712de0b-2e56-4cd4-b06f-ba3a870f2325-sys\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.152616 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.152438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b712de0b-2e56-4cd4-b06f-ba3a870f2325-root\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.152616 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.152505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.152616 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.152536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6sqs\" (UniqueName: \"kubernetes.io/projected/b712de0b-2e56-4cd4-b06f-ba3a870f2325-kube-api-access-r6sqs\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.152616 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.152556 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.152787 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.152634 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9b0f1015-7265-4919-98f3-874caec0fa27-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.152787 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.152651 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.152787 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.152651 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b0f1015-7265-4919-98f3-874caec0fa27-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.154301 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.154280 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.154667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.154647 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.154805 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.154783 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.171583 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.171523 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnvw5\" (UniqueName: \"kubernetes.io/projected/9b0f1015-7265-4919-98f3-874caec0fa27-kube-api-access-qnvw5\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.171751 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.171735 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzlgl\" (UniqueName: \"kubernetes.io/projected/dbc6b7fd-c95c-47fa-8319-76c3e90ef85b-kube-api-access-xzlgl\") pod \"openshift-state-metrics-84bd68b896-z2ws7\" (UID: \"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.249636 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.249604 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" Jul 09 16:08:28.252843 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.252819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b712de0b-2e56-4cd4-b06f-ba3a870f2325-sys\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.252940 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.252850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b712de0b-2e56-4cd4-b06f-ba3a870f2325-root\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.252940 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.252871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.252940 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.252888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6sqs\" (UniqueName: \"kubernetes.io/projected/b712de0b-2e56-4cd4-b06f-ba3a870f2325-kube-api-access-r6sqs\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.252940 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.252912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b712de0b-2e56-4cd4-b06f-ba3a870f2325-metrics-client-ca\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.252940 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.252930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-textfile\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.252940 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.252928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b712de0b-2e56-4cd4-b06f-ba3a870f2325-sys\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.253227 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.252941 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b712de0b-2e56-4cd4-b06f-ba3a870f2325-root\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.253227 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.252954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-wtmp\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.253227 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.253055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-tls\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.253227 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.253064 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-wtmp\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.253227 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.253101 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.253435 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.253348 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-textfile\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.253694 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.253674 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b712de0b-2e56-4cd4-b06f-ba3a870f2325-metrics-client-ca\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.253750 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.253674 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.255616 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.255596 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.255727 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.255708 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b712de0b-2e56-4cd4-b06f-ba3a870f2325-node-exporter-tls\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.261348 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.261329 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6sqs\" (UniqueName: \"kubernetes.io/projected/b712de0b-2e56-4cd4-b06f-ba3a870f2325-kube-api-access-r6sqs\") pod \"node-exporter-5xzl6\" (UID: \"b712de0b-2e56-4cd4-b06f-ba3a870f2325\") " pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.325709 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.325675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5xzl6" Jul 09 16:08:28.363897 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:28.363860 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb712de0b_2e56_4cd4_b06f_ba3a870f2325.slice/crio-775b3f85116eedbe88eda19aa4f40e15452c0e95509a8843cf36e286bc38a8fe WatchSource:0}: Error finding container 775b3f85116eedbe88eda19aa4f40e15452c0e95509a8843cf36e286bc38a8fe: Status 404 returned error can't find the container with id 775b3f85116eedbe88eda19aa4f40e15452c0e95509a8843cf36e286bc38a8fe Jul 09 16:08:28.416145 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.416121 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7"] Jul 09 16:08:28.418396 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:28.418372 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc6b7fd_c95c_47fa_8319_76c3e90ef85b.slice/crio-055c2fda9f76c7912593edc66763c598dd585b59230b574434bdbbe9251d0963 WatchSource:0}: Error finding container 055c2fda9f76c7912593edc66763c598dd585b59230b574434bdbbe9251d0963: Status 404 returned error can't find the container with id 055c2fda9f76c7912593edc66763c598dd585b59230b574434bdbbe9251d0963 Jul 09 16:08:28.655624 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.655584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.658152 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.658131 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b0f1015-7265-4919-98f3-874caec0fa27-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-mkjlb\" (UID: \"9b0f1015-7265-4919-98f3-874caec0fa27\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:28.897386 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:28.897351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" Jul 09 16:08:29.048957 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.048929 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-mkjlb"] Jul 09 16:08:29.052203 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:29.052176 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0f1015_7265_4919_98f3_874caec0fa27.slice/crio-676dcd694a60c5c64261ffc50201b592d823332e5df6fdf84628ce7d60916f07 WatchSource:0}: Error finding container 676dcd694a60c5c64261ffc50201b592d823332e5df6fdf84628ce7d60916f07: Status 404 returned error can't find the container with id 676dcd694a60c5c64261ffc50201b592d823332e5df6fdf84628ce7d60916f07 Jul 09 16:08:29.371893 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.371764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" event={"ID":"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b","Type":"ContainerStarted","Data":"399117373ae1853620fe546662b8af372d48136c896876df272c3e118c3d2e4e"} Jul 09 16:08:29.371893 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.371827 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" event={"ID":"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b","Type":"ContainerStarted","Data":"6b80c3b78c6f1f93907e03af28370423feb1c446dc06d1c32d4a41924a9ec8e8"} Jul 09 16:08:29.371893 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.371856 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" event={"ID":"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b","Type":"ContainerStarted","Data":"055c2fda9f76c7912593edc66763c598dd585b59230b574434bdbbe9251d0963"} Jul 09 16:08:29.373931 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.373619 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" event={"ID":"9b0f1015-7265-4919-98f3-874caec0fa27","Type":"ContainerStarted","Data":"676dcd694a60c5c64261ffc50201b592d823332e5df6fdf84628ce7d60916f07"} Jul 09 16:08:29.375422 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.375381 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xzl6" event={"ID":"b712de0b-2e56-4cd4-b06f-ba3a870f2325","Type":"ContainerStarted","Data":"775b3f85116eedbe88eda19aa4f40e15452c0e95509a8843cf36e286bc38a8fe"} Jul 09 16:08:29.765894 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.765800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:08:29.765894 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.765872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:08:29.769042 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.769018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ec37ae-7ff5-450e-be11-110cd92c71ad-metrics-tls\") pod \"dns-default-ntv5m\" (UID: \"a1ec37ae-7ff5-450e-be11-110cd92c71ad\") " pod="openshift-dns/dns-default-ntv5m" Jul 09 16:08:29.769159 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.769040 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"image-registry-67ddb9dcfb-dx5pl\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:08:29.962818 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.962786 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nnrq4\"" Jul 09 16:08:29.963041 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.963000 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tvt5b\"" Jul 09 16:08:29.968049 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.968022 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:08:29.968245 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:29.968221 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntv5m" Jul 09 16:08:30.186654 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:30.186494 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67ddb9dcfb-dx5pl"] Jul 09 16:08:30.188096 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:30.188033 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ntv5m"] Jul 09 16:08:30.189503 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:30.189458 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ec37ae_7ff5_450e_be11_110cd92c71ad.slice/crio-0d8b59c077207c4d7b79947edde9b7c7eb13bf47d496aacb63992599f2c5d611 WatchSource:0}: Error finding container 0d8b59c077207c4d7b79947edde9b7c7eb13bf47d496aacb63992599f2c5d611: Status 404 returned error can't find the container with id 0d8b59c077207c4d7b79947edde9b7c7eb13bf47d496aacb63992599f2c5d611 Jul 09 16:08:30.190343 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:30.190310 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111dae17_df4c_4556_adbe_55f1988aa74c.slice/crio-f10c3362996f6a7fed0be608b795dd3aeddd1e4bf24b7958e497c61d80d79917 WatchSource:0}: Error finding container f10c3362996f6a7fed0be608b795dd3aeddd1e4bf24b7958e497c61d80d79917: Status 404 returned error can't find the container with id f10c3362996f6a7fed0be608b795dd3aeddd1e4bf24b7958e497c61d80d79917 Jul 09 16:08:30.382239 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:30.382196 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" event={"ID":"dbc6b7fd-c95c-47fa-8319-76c3e90ef85b","Type":"ContainerStarted","Data":"ec6fe90b6b38386451f7c324268d3050ded3e7618f8b55020932882f2b85905b"} Jul 09 16:08:30.383892 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:30.383861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntv5m" event={"ID":"a1ec37ae-7ff5-450e-be11-110cd92c71ad","Type":"ContainerStarted","Data":"0d8b59c077207c4d7b79947edde9b7c7eb13bf47d496aacb63992599f2c5d611"} Jul 09 16:08:30.386580 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:30.385802 2581 generic.go:356] "Generic (PLEG): container finished" podID="b712de0b-2e56-4cd4-b06f-ba3a870f2325" containerID="3c4fe3b57c56f852db40e43427139c53835195e3e4f942eeacfd7958acf9eac9" exitCode=0 Jul 09 16:08:30.386580 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:30.385896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xzl6" event={"ID":"b712de0b-2e56-4cd4-b06f-ba3a870f2325","Type":"ContainerDied","Data":"3c4fe3b57c56f852db40e43427139c53835195e3e4f942eeacfd7958acf9eac9"} Jul 09 16:08:30.388200 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:30.388174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" event={"ID":"111dae17-df4c-4556-adbe-55f1988aa74c","Type":"ContainerStarted","Data":"bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980"} Jul 09 16:08:30.388317 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:30.388221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" event={"ID":"111dae17-df4c-4556-adbe-55f1988aa74c","Type":"ContainerStarted","Data":"f10c3362996f6a7fed0be608b795dd3aeddd1e4bf24b7958e497c61d80d79917"} Jul 09 16:08:30.388317 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:30.388261 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:08:30.407823 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:30.407755 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-z2ws7" podStartSLOduration=2.193226308 podStartE2EDuration="3.407732895s" totalImagesPullingTime="1.214506587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:30.406345875 +0000 UTC m=+287.477941849" watchObservedRunningTime="2026-07-09 16:08:30.407732895 +0000 UTC m=+287.479328846" Jul 09 16:08:30.437144 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:30.437087 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" podStartSLOduration=286.437066704 podStartE2EDuration="4m46.437066704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:30.436975689 +0000 UTC m=+287.508571639" watchObservedRunningTime="2026-07-09 16:08:30.437066704 +0000 UTC m=+287.508662654" Jul 09 16:08:31.393837 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:31.393796 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" event={"ID":"9b0f1015-7265-4919-98f3-874caec0fa27","Type":"ContainerStarted","Data":"5b9b2daa45ca86bce9a9b377723f037c971edd3390247f4fc6dbf20e4be21f37"} Jul 09 16:08:31.394316 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:31.393909 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" event={"ID":"9b0f1015-7265-4919-98f3-874caec0fa27","Type":"ContainerStarted","Data":"ffe2b3eb8e17d93a7858d00c215634d717505b6b32579b29d1314436a6b602cf"} Jul 09 16:08:31.394316 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:31.393936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" event={"ID":"9b0f1015-7265-4919-98f3-874caec0fa27","Type":"ContainerStarted","Data":"65d0c959be05843fbec5d90b9e04de467a3bf0b02703813bad36d3a6593eef3d"} Jul 09 16:08:31.395879 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:31.395853 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xzl6" event={"ID":"b712de0b-2e56-4cd4-b06f-ba3a870f2325","Type":"ContainerStarted","Data":"395a7fcc9d2ca9478f2e124eed130bbfaf5a3119e91a31afe48ffc72795c9b12"} Jul 09 16:08:31.395993 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:31.395896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xzl6" event={"ID":"b712de0b-2e56-4cd4-b06f-ba3a870f2325","Type":"ContainerStarted","Data":"7fae59ace60a40feefc77d332f6a6a0547ca0b668127a0b2e81fcd7039a0b840"} Jul 09 16:08:31.412760 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:31.412713 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-mkjlb" podStartSLOduration=2.862678941 podStartE2EDuration="4.412699303s" totalImagesPullingTime="1.550020362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:31.412210909 +0000 UTC m=+288.483806859" watchObservedRunningTime="2026-07-09 16:08:31.412699303 +0000 UTC m=+288.484295254" Jul 09 16:08:31.433569 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:31.433523 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5xzl6" podStartSLOduration=2.823501276 podStartE2EDuration="4.433509579s" totalImagesPullingTime="1.508736855s" totalInitContainerRuntime="101.271448ms" isStatefulPod=true podCreationTimestamp="2026-07-09 16:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:31.432457123 +0000 UTC m=+288.504053110" watchObservedRunningTime="2026-07-09 16:08:31.433509579 +0000 UTC m=+288.505105529" Jul 09 16:08:32.657962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:32.657939 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w"] Jul 09 16:08:32.660993 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:32.660961 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" Jul 09 16:08:32.663582 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:32.663558 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 16:08:32.663877 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:32.663560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zm9bq\"" Jul 09 16:08:32.669350 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:32.669329 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w"] Jul 09 16:08:32.796129 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:32.796037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f6bad0e4-fc14-4e8f-928b-ac56d0b428ba-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-mtv6w\" (UID: \"f6bad0e4-fc14-4e8f-928b-ac56d0b428ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" Jul 09 16:08:32.796129 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:32.796125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhndj\" (UniqueName: \"kubernetes.io/projected/f6bad0e4-fc14-4e8f-928b-ac56d0b428ba-kube-api-access-bhndj\") pod \"monitoring-plugin-5f68df7f58-mtv6w\" (UID: \"f6bad0e4-fc14-4e8f-928b-ac56d0b428ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" Jul 09 16:08:32.896573 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:32.896536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhndj\" (UniqueName: \"kubernetes.io/projected/f6bad0e4-fc14-4e8f-928b-ac56d0b428ba-kube-api-access-bhndj\") pod \"monitoring-plugin-5f68df7f58-mtv6w\" (UID: \"f6bad0e4-fc14-4e8f-928b-ac56d0b428ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" Jul 09 16:08:32.896746 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:32.896594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f6bad0e4-fc14-4e8f-928b-ac56d0b428ba-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-mtv6w\" (UID: \"f6bad0e4-fc14-4e8f-928b-ac56d0b428ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" Jul 09 16:08:32.896746 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:08:32.896681 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 09 16:08:32.896746 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:08:32.896735 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bad0e4-fc14-4e8f-928b-ac56d0b428ba-monitoring-plugin-cert podName:f6bad0e4-fc14-4e8f-928b-ac56d0b428ba nodeName:}" failed. No retries permitted until 2026-07-09 16:08:33.396721408 +0000 UTC m=+290.468317336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f6bad0e4-fc14-4e8f-928b-ac56d0b428ba-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-mtv6w" (UID: "f6bad0e4-fc14-4e8f-928b-ac56d0b428ba") : secret "monitoring-plugin-cert" not found Jul 09 16:08:32.906007 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:32.905968 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhndj\" (UniqueName: \"kubernetes.io/projected/f6bad0e4-fc14-4e8f-928b-ac56d0b428ba-kube-api-access-bhndj\") pod \"monitoring-plugin-5f68df7f58-mtv6w\" (UID: \"f6bad0e4-fc14-4e8f-928b-ac56d0b428ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" Jul 09 16:08:33.401622 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.401591 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f6bad0e4-fc14-4e8f-928b-ac56d0b428ba-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-mtv6w\" (UID: \"f6bad0e4-fc14-4e8f-928b-ac56d0b428ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" Jul 09 16:08:33.404158 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.404129 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f6bad0e4-fc14-4e8f-928b-ac56d0b428ba-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-mtv6w\" (UID: \"f6bad0e4-fc14-4e8f-928b-ac56d0b428ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" Jul 09 16:08:33.406100 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.406071 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntv5m" event={"ID":"a1ec37ae-7ff5-450e-be11-110cd92c71ad","Type":"ContainerStarted","Data":"509ca1168dbfaf3889d6a110a061f3f311f8dcc26aec4d1348aea8e3a748a16f"} Jul 09 16:08:33.406229 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.406131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntv5m" event={"ID":"a1ec37ae-7ff5-450e-be11-110cd92c71ad","Type":"ContainerStarted","Data":"0b7736ede0cb1401cf37692f4c6725a654015de29738b0c449896cf0744853ae"} Jul 09 16:08:33.406229 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.406163 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ntv5m" Jul 09 16:08:33.423788 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.423738 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ntv5m" podStartSLOduration=252.115039583 podStartE2EDuration="4m14.423721894s" totalImagesPullingTime="2.308682311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:33.421607941 +0000 UTC m=+290.493203892" watchObservedRunningTime="2026-07-09 16:08:33.423721894 +0000 UTC m=+290.495317840" Jul 09 16:08:33.571377 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.571327 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" Jul 09 16:08:33.702980 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.702909 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w"] Jul 09 16:08:33.705673 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:33.705645 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6bad0e4_fc14_4e8f_928b_ac56d0b428ba.slice/crio-dd50b1c6c0b3861513e5bed2b968443f4c7386ea8d6d894f95d94325750bf415 WatchSource:0}: Error finding container dd50b1c6c0b3861513e5bed2b968443f4c7386ea8d6d894f95d94325750bf415: Status 404 returned error can't find the container with id dd50b1c6c0b3861513e5bed2b968443f4c7386ea8d6d894f95d94325750bf415 Jul 09 16:08:33.930094 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.930011 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-7skjs"] Jul 09 16:08:33.934637 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.934615 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-7skjs" Jul 09 16:08:33.937522 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.937499 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rhf2z\"" Jul 09 16:08:33.937735 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.937714 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 16:08:33.937836 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.937751 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 16:08:33.944441 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:33.944414 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-7skjs"] Jul 09 16:08:34.006833 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.006795 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmjkd\" (UniqueName: \"kubernetes.io/projected/ed0b06bb-ef74-4704-b234-5922d7076132-kube-api-access-cmjkd\") pod \"downloads-68c9cbb497-7skjs\" (UID: \"ed0b06bb-ef74-4704-b234-5922d7076132\") " pod="openshift-console/downloads-68c9cbb497-7skjs" Jul 09 16:08:34.107569 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.107531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjkd\" (UniqueName: \"kubernetes.io/projected/ed0b06bb-ef74-4704-b234-5922d7076132-kube-api-access-cmjkd\") pod \"downloads-68c9cbb497-7skjs\" (UID: \"ed0b06bb-ef74-4704-b234-5922d7076132\") " pod="openshift-console/downloads-68c9cbb497-7skjs" Jul 09 16:08:34.116174 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.116142 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmjkd\" (UniqueName: \"kubernetes.io/projected/ed0b06bb-ef74-4704-b234-5922d7076132-kube-api-access-cmjkd\") pod \"downloads-68c9cbb497-7skjs\" (UID: \"ed0b06bb-ef74-4704-b234-5922d7076132\") " pod="openshift-console/downloads-68c9cbb497-7skjs" Jul 09 16:08:34.246241 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.246158 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-7skjs" Jul 09 16:08:34.317204 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.317172 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:08:34.321121 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.321097 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.324377 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.324352 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 16:08:34.324516 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.324448 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 16:08:34.324623 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.324605 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 16:08:34.324693 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.324661 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 16:08:34.324754 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.324713 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 16:08:34.325019 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.325006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 16:08:34.325019 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.325012 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 16:08:34.327354 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.327332 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 16:08:34.330661 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.328792 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 16:08:34.330661 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.328880 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-klx5x\"" Jul 09 16:08:34.330661 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.330002 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 16:08:34.330661 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.330167 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8kmhvmociintd\"" Jul 09 16:08:34.330661 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.330269 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 16:08:34.330661 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.330422 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 16:08:34.330661 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.330422 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 16:08:34.330661 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.330424 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 16:08:34.334529 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.334508 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 16:08:34.339862 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.339838 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:08:34.394326 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.394303 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-7skjs"] Jul 09 16:08:34.396143 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:34.396115 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0b06bb_ef74_4704_b234_5922d7076132.slice/crio-37a8a03cc5856a2a853f052e4681e932246086e106ccb85cb6ffdebefadb3a04 WatchSource:0}: Error finding container 37a8a03cc5856a2a853f052e4681e932246086e106ccb85cb6ffdebefadb3a04: Status 404 returned error can't find the container with id 37a8a03cc5856a2a853f052e4681e932246086e106ccb85cb6ffdebefadb3a04 Jul 09 16:08:34.410632 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410608 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.410765 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.410765 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.410765 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410753 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.410916 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.410916 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.410916 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-config-out\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.410916 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410920 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-config\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410958 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-web-config\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.410999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411085 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.411071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411305 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.411092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x69sn\" (UniqueName: \"kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-kube-api-access-x69sn\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411305 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.411137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411305 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.411160 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411305 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.411214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411305 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.411239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411305 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.411259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.411758 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.411733 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-7skjs" event={"ID":"ed0b06bb-ef74-4704-b234-5922d7076132","Type":"ContainerStarted","Data":"37a8a03cc5856a2a853f052e4681e932246086e106ccb85cb6ffdebefadb3a04"} Jul 09 16:08:34.412987 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.412961 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" event={"ID":"f6bad0e4-fc14-4e8f-928b-ac56d0b428ba","Type":"ContainerStarted","Data":"dd50b1c6c0b3861513e5bed2b968443f4c7386ea8d6d894f95d94325750bf415"} Jul 09 16:08:34.511924 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.511842 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.511924 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.511911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512141 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.511944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512141 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.511985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512141 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512275 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512332 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-config-out\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512332 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512424 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512273 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512424 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512424 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-config\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512614 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512614 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-web-config\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512614 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512614 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512614 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x69sn\" (UniqueName: \"kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-kube-api-access-x69sn\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.512864 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.512630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.513075 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.513049 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.513821 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.513796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.514822 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.514511 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.515575 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.515550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.515669 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.515609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.515669 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.515643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.515826 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.515720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.516321 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.516301 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.518968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.516362 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.518968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.516573 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-config\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.518968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.516786 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.518968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.516869 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.518968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.517160 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.518968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.517401 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.518968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.517543 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.518968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.517660 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.518968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.518008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-web-config\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.518968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.518031 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.518968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.518905 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.519564 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.519533 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-config-out\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.520053 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.520029 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.520053 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.520045 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.524841 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.524820 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x69sn\" (UniqueName: \"kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-kube-api-access-x69sn\") pod \"prometheus-k8s-0\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.634223 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.634164 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:34.796957 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:34.796926 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:08:34.799928 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:08:34.799893 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af49315_0808_4eec_9900_b8ff00c00f94.slice/crio-c7e1f29c776f09f19479cd936f01061b0f77e747a62d4ba884ae2159c33351e6 WatchSource:0}: Error finding container c7e1f29c776f09f19479cd936f01061b0f77e747a62d4ba884ae2159c33351e6: Status 404 returned error can't find the container with id c7e1f29c776f09f19479cd936f01061b0f77e747a62d4ba884ae2159c33351e6 Jul 09 16:08:35.419312 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:35.419272 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerStarted","Data":"c7e1f29c776f09f19479cd936f01061b0f77e747a62d4ba884ae2159c33351e6"} Jul 09 16:08:35.421537 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:35.421505 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" event={"ID":"f6bad0e4-fc14-4e8f-928b-ac56d0b428ba","Type":"ContainerStarted","Data":"be586843199ed9913ae35a2593d49ab4bf37ef248128b7b401cc7594d94a3b5e"} Jul 09 16:08:35.422012 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:35.421946 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" Jul 09 16:08:35.427188 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:35.427164 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" Jul 09 16:08:35.439092 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:35.439042 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-mtv6w" podStartSLOduration=1.8679863380000001 podStartE2EDuration="3.439025931s" totalImagesPullingTime="1.571039593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:35.437838215 +0000 UTC m=+292.509434166" watchObservedRunningTime="2026-07-09 16:08:35.439025931 +0000 UTC m=+292.510621882" Jul 09 16:08:36.427715 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:36.427675 2581 generic.go:356] "Generic (PLEG): container finished" podID="4af49315-0808-4eec-9900-b8ff00c00f94" containerID="6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73" exitCode=0 Jul 09 16:08:36.428148 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:36.427776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerDied","Data":"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73"} Jul 09 16:08:40.455380 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:40.455346 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerStarted","Data":"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d"} Jul 09 16:08:40.455839 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:40.455436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerStarted","Data":"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48"} Jul 09 16:08:40.507417 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:08:40.507318 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-k74h8" podUID="865c284a-ea51-4053-9d3e-32524736479b" Jul 09 16:08:43.379023 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:43.378968 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:08:43.379941 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:43.379914 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:08:43.386271 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:43.386250 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 16:08:43.416115 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:43.415952 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ntv5m" Jul 09 16:08:43.471659 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:43.471620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerStarted","Data":"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5"} Jul 09 16:08:43.471827 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:43.471702 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerStarted","Data":"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d"} Jul 09 16:08:43.471827 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:43.471740 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerStarted","Data":"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77"} Jul 09 16:08:43.471827 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:43.471776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerStarted","Data":"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a"} Jul 09 16:08:43.499151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:43.499094 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.416519068 podStartE2EDuration="9.49907479s" totalImagesPullingTime="7.064068072s" totalInitContainerRuntime="18.48765ms" isStatefulPod=false podCreationTimestamp="2026-07-09 16:08:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:43.49668407 +0000 UTC m=+300.568280019" watchObservedRunningTime="2026-07-09 16:08:43.49907479 +0000 UTC m=+300.570670745" Jul 09 16:08:44.635087 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:44.635043 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:08:49.973048 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:49.973004 2581 patch_prober.go:28] interesting pod/image-registry-67ddb9dcfb-dx5pl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 16:08:49.973515 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:49.973073 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" podUID="111dae17-df4c-4556-adbe-55f1988aa74c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 16:08:51.400614 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:51.400582 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:08:53.028898 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:53.028865 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67ddb9dcfb-dx5pl"] Jul 09 16:08:55.505331 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:55.505296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:08:58.546661 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:58.546573 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-7skjs" event={"ID":"ed0b06bb-ef74-4704-b234-5922d7076132","Type":"ContainerStarted","Data":"65fe3b8a98c416ec69dbe91201e8527900b9c254c2ba08996c74d6972b60498a"} Jul 09 16:08:58.546661 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:58.546643 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-7skjs" Jul 09 16:08:58.557762 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:58.557730 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-7skjs" Jul 09 16:08:58.566912 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:08:58.566861 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-7skjs" podStartSLOduration=1.8465291449999999 podStartE2EDuration="25.566844683s" totalImagesPullingTime="23.720315538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:08:58.563851018 +0000 UTC m=+315.635446969" watchObservedRunningTime="2026-07-09 16:08:58.566844683 +0000 UTC m=+315.638440634" Jul 09 16:09:05.587017 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:05.586977 2581 generic.go:356] "Generic (PLEG): container finished" podID="9f07b5b8-474a-4cb0-98d2-62d11e08dfde" containerID="75cffc42785f3a1ced7006b2bb13f244da1ea4384762d83c92f2056ff09cc2b2" exitCode=0 Jul 09 16:09:05.587519 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:05.587062 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-27c27" event={"ID":"9f07b5b8-474a-4cb0-98d2-62d11e08dfde","Type":"ContainerDied","Data":"75cffc42785f3a1ced7006b2bb13f244da1ea4384762d83c92f2056ff09cc2b2"} Jul 09 16:09:05.587519 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:05.587514 2581 scope.go:117] "RemoveContainer" containerID="75cffc42785f3a1ced7006b2bb13f244da1ea4384762d83c92f2056ff09cc2b2" Jul 09 16:09:06.332051 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:06.332020 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rpd2k_62121c21-50ff-4149-80f8-9fcbd30865d4/serve-healthcheck-canary/0.log" Jul 09 16:09:06.594299 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:06.594220 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-27c27" event={"ID":"9f07b5b8-474a-4cb0-98d2-62d11e08dfde","Type":"ContainerStarted","Data":"414e6e066055d9c32f68731d69dd763c8736d03c44d752644f14f2cbe45d416b"} Jul 09 16:09:18.054629 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.054568 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" podUID="111dae17-df4c-4556-adbe-55f1988aa74c" containerName="registry" containerID="cri-o://bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980" gracePeriod=30 Jul 09 16:09:18.369883 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.369445 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:09:18.538073 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.538044 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-image-registry-private-configuration\") pod \"111dae17-df4c-4556-adbe-55f1988aa74c\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " Jul 09 16:09:18.538073 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.538079 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-bound-sa-token\") pod \"111dae17-df4c-4556-adbe-55f1988aa74c\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " Jul 09 16:09:18.538321 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.538099 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") pod \"111dae17-df4c-4556-adbe-55f1988aa74c\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " Jul 09 16:09:18.538321 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.538119 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-trusted-ca\") pod \"111dae17-df4c-4556-adbe-55f1988aa74c\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " Jul 09 16:09:18.538321 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.538138 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jqq9\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-kube-api-access-2jqq9\") pod \"111dae17-df4c-4556-adbe-55f1988aa74c\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " Jul 09 16:09:18.538321 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.538202 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-installation-pull-secrets\") pod \"111dae17-df4c-4556-adbe-55f1988aa74c\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " Jul 09 16:09:18.538321 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.538246 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/111dae17-df4c-4556-adbe-55f1988aa74c-ca-trust-extracted\") pod \"111dae17-df4c-4556-adbe-55f1988aa74c\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " Jul 09 16:09:18.538321 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.538305 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-registry-certificates\") pod \"111dae17-df4c-4556-adbe-55f1988aa74c\" (UID: \"111dae17-df4c-4556-adbe-55f1988aa74c\") " Jul 09 16:09:18.538665 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.538529 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "111dae17-df4c-4556-adbe-55f1988aa74c" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:09:18.538720 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.538688 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-trusted-ca\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:18.538884 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.538831 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "111dae17-df4c-4556-adbe-55f1988aa74c" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:09:18.540983 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.540953 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "111dae17-df4c-4556-adbe-55f1988aa74c" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:09:18.541637 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.541606 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-kube-api-access-2jqq9" (OuterVolumeSpecName: "kube-api-access-2jqq9") pod "111dae17-df4c-4556-adbe-55f1988aa74c" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c"). InnerVolumeSpecName "kube-api-access-2jqq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:09:18.541726 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.541682 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "111dae17-df4c-4556-adbe-55f1988aa74c" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:09:18.541800 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.541771 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "111dae17-df4c-4556-adbe-55f1988aa74c" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:09:18.541924 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.541905 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "111dae17-df4c-4556-adbe-55f1988aa74c" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:09:18.550273 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.550245 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/111dae17-df4c-4556-adbe-55f1988aa74c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "111dae17-df4c-4556-adbe-55f1988aa74c" (UID: "111dae17-df4c-4556-adbe-55f1988aa74c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:09:18.639154 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.639127 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-installation-pull-secrets\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:18.639154 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.639151 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/111dae17-df4c-4556-adbe-55f1988aa74c-ca-trust-extracted\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:18.639154 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.639161 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/111dae17-df4c-4556-adbe-55f1988aa74c-registry-certificates\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:18.639444 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.639171 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/111dae17-df4c-4556-adbe-55f1988aa74c-image-registry-private-configuration\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:18.639444 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.639187 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-bound-sa-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:18.639444 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.639196 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-registry-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:18.639444 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.639204 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jqq9\" (UniqueName: \"kubernetes.io/projected/111dae17-df4c-4556-adbe-55f1988aa74c-kube-api-access-2jqq9\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:18.643676 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.643645 2581 generic.go:356] "Generic (PLEG): container finished" podID="111dae17-df4c-4556-adbe-55f1988aa74c" containerID="bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980" exitCode=0 Jul 09 16:09:18.643806 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.643708 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" event={"ID":"111dae17-df4c-4556-adbe-55f1988aa74c","Type":"ContainerDied","Data":"bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980"} Jul 09 16:09:18.643806 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.643721 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" Jul 09 16:09:18.643806 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.643749 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67ddb9dcfb-dx5pl" event={"ID":"111dae17-df4c-4556-adbe-55f1988aa74c","Type":"ContainerDied","Data":"f10c3362996f6a7fed0be608b795dd3aeddd1e4bf24b7958e497c61d80d79917"} Jul 09 16:09:18.643806 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.643780 2581 scope.go:117] "RemoveContainer" containerID="bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980" Jul 09 16:09:18.653518 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.653502 2581 scope.go:117] "RemoveContainer" containerID="bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980" Jul 09 16:09:18.653839 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:09:18.653807 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980\": container with ID starting with bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980 not found: ID does not exist" containerID="bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980" Jul 09 16:09:18.653929 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.653849 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980"} err="failed to get container status \"bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980\": rpc error: code = NotFound desc = could not find container \"bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980\": container with ID starting with bc0b08fc86bbdd79a493b0026b9a681a38f59f5004663b5af8bbb36983c24980 not found: ID does not exist" Jul 09 16:09:18.669748 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.669713 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67ddb9dcfb-dx5pl"] Jul 09 16:09:18.675960 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:18.675925 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67ddb9dcfb-dx5pl"] Jul 09 16:09:19.511725 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:19.511691 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="111dae17-df4c-4556-adbe-55f1988aa74c" path="/var/lib/kubelet/pods/111dae17-df4c-4556-adbe-55f1988aa74c/volumes" Jul 09 16:09:30.697586 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:30.697551 2581 generic.go:356] "Generic (PLEG): container finished" podID="e80700fa-9145-499b-b127-97147a7266cd" containerID="e362ee8598364df37620b59d4e4828419937a7903036115112d8ac4a9d9085de" exitCode=0 Jul 09 16:09:30.697983 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:30.697626 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" event={"ID":"e80700fa-9145-499b-b127-97147a7266cd","Type":"ContainerDied","Data":"e362ee8598364df37620b59d4e4828419937a7903036115112d8ac4a9d9085de"} Jul 09 16:09:30.697983 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:30.697941 2581 scope.go:117] "RemoveContainer" containerID="e362ee8598364df37620b59d4e4828419937a7903036115112d8ac4a9d9085de" Jul 09 16:09:31.703057 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:31.703021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vbzdt" event={"ID":"e80700fa-9145-499b-b127-97147a7266cd","Type":"ContainerStarted","Data":"a22b39e18fd2c6ac8dd9aaff1ca8b7c7e6a902556d855c86b99c8c8ce27c5121"} Jul 09 16:09:34.635102 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:34.635010 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:34.684846 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:34.684820 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:34.732918 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:34.732893 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:52.762040 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:52.762003 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:09:52.762565 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:52.762317 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="prometheus" containerID="cri-o://88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48" gracePeriod=600 Jul 09 16:09:52.762565 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:52.762317 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy" containerID="cri-o://b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d" gracePeriod=600 Jul 09 16:09:52.762565 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:52.762383 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy-web" containerID="cri-o://27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77" gracePeriod=600 Jul 09 16:09:52.762565 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:52.762424 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="config-reloader" containerID="cri-o://a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d" gracePeriod=600 Jul 09 16:09:52.762565 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:52.762382 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5" gracePeriod=600 Jul 09 16:09:52.762794 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:52.762587 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="thanos-sidecar" containerID="cri-o://29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a" gracePeriod=600 Jul 09 16:09:53.008538 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.008455 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.114415 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114389 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-kube-rbac-proxy\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.114583 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114427 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-1\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.114583 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114445 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-metrics-client-ca\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.114583 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114487 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-tls-assets\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.114583 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114511 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-2\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.114818 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114712 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-db\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.114818 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114763 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-kubelet-serving-ca-bundle\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.114818 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114793 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-thanos-prometheus-http-client-file\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.114969 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114818 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-config\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.114969 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114841 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:09:53.114969 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114851 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:09:53.114969 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114857 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-trusted-ca-bundle\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.114969 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114909 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-config-out\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.114969 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.114906 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:09:53.115317 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.115261 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:09:53.115388 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.115378 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-tls\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.115644 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.115423 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.115644 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.115489 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-metrics-client-certs\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.115644 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.115501 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:09:53.115644 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.115533 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.115644 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.115565 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-web-config\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.115898 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.115676 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-grpc-tls\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.115898 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.115813 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x69sn\" (UniqueName: \"kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-kube-api-access-x69sn\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.115898 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.115849 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-serving-certs-ca-bundle\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.115898 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.115878 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-0\") pod \"4af49315-0808-4eec-9900-b8ff00c00f94\" (UID: \"4af49315-0808-4eec-9900-b8ff00c00f94\") " Jul 09 16:09:53.116155 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.116132 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.116214 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.116162 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-metrics-client-ca\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.116214 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.116180 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.116214 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.116198 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.116214 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.116212 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.117127 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.117001 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:09:53.117389 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.117362 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:09:53.117525 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.117494 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:09:53.117617 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.117591 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:09:53.117721 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.117695 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:09:53.118110 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.117852 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-config-out" (OuterVolumeSpecName: "config-out") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:09:53.118284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.118259 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:09:53.118673 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.118642 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-config" (OuterVolumeSpecName: "config") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:09:53.118673 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.118643 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:09:53.119633 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.119601 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:09:53.119732 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.119641 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-kube-api-access-x69sn" (OuterVolumeSpecName: "kube-api-access-x69sn") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "kube-api-access-x69sn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:09:53.119968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.119948 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:09:53.120042 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.120010 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:09:53.120606 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.120583 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:09:53.130644 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.130624 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-web-config" (OuterVolumeSpecName: "web-config") pod "4af49315-0808-4eec-9900-b8ff00c00f94" (UID: "4af49315-0808-4eec-9900-b8ff00c00f94"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:09:53.216783 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216754 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x69sn\" (UniqueName: \"kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-kube-api-access-x69sn\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.216783 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216782 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.216783 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216792 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216800 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-kube-rbac-proxy\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216810 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4af49315-0808-4eec-9900-b8ff00c00f94-tls-assets\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216818 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-prometheus-k8s-db\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216825 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216834 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216843 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4af49315-0808-4eec-9900-b8ff00c00f94-config-out\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216851 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216859 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216867 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-metrics-client-certs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216876 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216884 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-web-config\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.217027 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.216891 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4af49315-0808-4eec-9900-b8ff00c00f94-secret-grpc-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:09:53.795384 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795352 2581 generic.go:356] "Generic (PLEG): container finished" podID="4af49315-0808-4eec-9900-b8ff00c00f94" containerID="e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5" exitCode=0 Jul 09 16:09:53.795384 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795378 2581 generic.go:356] "Generic (PLEG): container finished" podID="4af49315-0808-4eec-9900-b8ff00c00f94" containerID="b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d" exitCode=0 Jul 09 16:09:53.795384 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795386 2581 generic.go:356] "Generic (PLEG): container finished" podID="4af49315-0808-4eec-9900-b8ff00c00f94" containerID="27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77" exitCode=0 Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795393 2581 generic.go:356] "Generic (PLEG): container finished" podID="4af49315-0808-4eec-9900-b8ff00c00f94" containerID="29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a" exitCode=0 Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795401 2581 generic.go:356] "Generic (PLEG): container finished" podID="4af49315-0808-4eec-9900-b8ff00c00f94" containerID="a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d" exitCode=0 Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795407 2581 generic.go:356] "Generic (PLEG): container finished" podID="4af49315-0808-4eec-9900-b8ff00c00f94" containerID="88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48" exitCode=0 Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795433 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795446 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerDied","Data":"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5"} Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795537 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerDied","Data":"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d"} Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795568 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerDied","Data":"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77"} Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795592 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerDied","Data":"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a"} Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795613 2581 scope.go:117] "RemoveContainer" containerID="e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5" Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795626 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerDied","Data":"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d"} Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795655 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerDied","Data":"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48"} Jul 09 16:09:53.795896 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.795679 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af49315-0808-4eec-9900-b8ff00c00f94","Type":"ContainerDied","Data":"c7e1f29c776f09f19479cd936f01061b0f77e747a62d4ba884ae2159c33351e6"} Jul 09 16:09:53.804535 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.804515 2581 scope.go:117] "RemoveContainer" containerID="b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d" Jul 09 16:09:53.812194 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.812170 2581 scope.go:117] "RemoveContainer" containerID="27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77" Jul 09 16:09:53.819414 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.819384 2581 scope.go:117] "RemoveContainer" containerID="29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a" Jul 09 16:09:53.820950 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.820932 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:09:53.825285 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.825266 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:09:53.827441 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.827416 2581 scope.go:117] "RemoveContainer" containerID="a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d" Jul 09 16:09:53.834495 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.834458 2581 scope.go:117] "RemoveContainer" containerID="88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48" Jul 09 16:09:53.842296 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.842275 2581 scope.go:117] "RemoveContainer" containerID="6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73" Jul 09 16:09:53.849856 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.849831 2581 scope.go:117] "RemoveContainer" containerID="e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5" Jul 09 16:09:53.850151 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:09:53.850134 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": container with ID starting with e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5 not found: ID does not exist" containerID="e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5" Jul 09 16:09:53.850206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850162 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5"} err="failed to get container status \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": rpc error: code = NotFound desc = could not find container \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": container with ID starting with e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5 not found: ID does not exist" Jul 09 16:09:53.850206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850181 2581 scope.go:117] "RemoveContainer" containerID="b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d" Jul 09 16:09:53.850206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850196 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:09:53.850430 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:09:53.850411 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": container with ID starting with b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d not found: ID does not exist" containerID="b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d" Jul 09 16:09:53.850482 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850434 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d"} err="failed to get container status \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": rpc error: code = NotFound desc = could not find container \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": container with ID starting with b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d not found: ID does not exist" Jul 09 16:09:53.850482 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850447 2581 scope.go:117] "RemoveContainer" containerID="27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77" Jul 09 16:09:53.850621 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850600 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850629 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850645 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy-thanos" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850656 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy-thanos" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850665 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="prometheus" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850670 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="prometheus" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850678 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="config-reloader" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850683 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="config-reloader" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850691 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="thanos-sidecar" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850696 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="thanos-sidecar" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850703 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="init-config-reloader" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850709 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="init-config-reloader" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850715 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy-web" Jul 09 16:09:53.850718 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:09:53.850711 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": container with ID starting with 27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77 not found: ID does not exist" containerID="27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850732 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77"} err="failed to get container status \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": rpc error: code = NotFound desc = could not find container \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": container with ID starting with 27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77 not found: ID does not exist" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850750 2581 scope.go:117] "RemoveContainer" containerID="29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850720 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy-web" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850808 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="111dae17-df4c-4556-adbe-55f1988aa74c" containerName="registry" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850815 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="111dae17-df4c-4556-adbe-55f1988aa74c" containerName="registry" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850889 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy-web" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850898 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="config-reloader" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850904 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850913 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="111dae17-df4c-4556-adbe-55f1988aa74c" containerName="registry" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850922 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="prometheus" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850929 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="kube-rbac-proxy-thanos" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.850939 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" containerName="thanos-sidecar" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:09:53.850987 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": container with ID starting with 29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a not found: ID does not exist" containerID="29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.851023 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a"} err="failed to get container status \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": rpc error: code = NotFound desc = could not find container \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": container with ID starting with 29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a not found: ID does not exist" Jul 09 16:09:53.851168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.851040 2581 scope.go:117] "RemoveContainer" containerID="a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d" Jul 09 16:09:53.851774 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:09:53.851323 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": container with ID starting with a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d not found: ID does not exist" containerID="a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d" Jul 09 16:09:53.851774 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.851341 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d"} err="failed to get container status \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": rpc error: code = NotFound desc = could not find container \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": container with ID starting with a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d not found: ID does not exist" Jul 09 16:09:53.851774 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.851355 2581 scope.go:117] "RemoveContainer" containerID="88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48" Jul 09 16:09:53.851774 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:09:53.851621 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": container with ID starting with 88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48 not found: ID does not exist" containerID="88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48" Jul 09 16:09:53.851774 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.851648 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48"} err="failed to get container status \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": rpc error: code = NotFound desc = could not find container \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": container with ID starting with 88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48 not found: ID does not exist" Jul 09 16:09:53.851774 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.851661 2581 scope.go:117] "RemoveContainer" containerID="6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73" Jul 09 16:09:53.851972 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:09:53.851870 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": container with ID starting with 6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73 not found: ID does not exist" containerID="6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73" Jul 09 16:09:53.851972 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.851887 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73"} err="failed to get container status \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": rpc error: code = NotFound desc = could not find container \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": container with ID starting with 6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73 not found: ID does not exist" Jul 09 16:09:53.851972 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.851900 2581 scope.go:117] "RemoveContainer" containerID="e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5" Jul 09 16:09:53.852122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.852104 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5"} err="failed to get container status \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": rpc error: code = NotFound desc = could not find container \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": container with ID starting with e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5 not found: ID does not exist" Jul 09 16:09:53.852161 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.852122 2581 scope.go:117] "RemoveContainer" containerID="b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d" Jul 09 16:09:53.852354 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.852334 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d"} err="failed to get container status \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": rpc error: code = NotFound desc = could not find container \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": container with ID starting with b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d not found: ID does not exist" Jul 09 16:09:53.852408 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.852356 2581 scope.go:117] "RemoveContainer" containerID="27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77" Jul 09 16:09:53.852697 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.852678 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77"} err="failed to get container status \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": rpc error: code = NotFound desc = could not find container \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": container with ID starting with 27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77 not found: ID does not exist" Jul 09 16:09:53.852746 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.852699 2581 scope.go:117] "RemoveContainer" containerID="29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a" Jul 09 16:09:53.852942 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.852920 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a"} err="failed to get container status \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": rpc error: code = NotFound desc = could not find container \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": container with ID starting with 29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a not found: ID does not exist" Jul 09 16:09:53.853000 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.852959 2581 scope.go:117] "RemoveContainer" containerID="a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d" Jul 09 16:09:53.853206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.853187 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d"} err="failed to get container status \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": rpc error: code = NotFound desc = could not find container \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": container with ID starting with a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d not found: ID does not exist" Jul 09 16:09:53.853206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.853206 2581 scope.go:117] "RemoveContainer" containerID="88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48" Jul 09 16:09:53.853454 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.853438 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48"} err="failed to get container status \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": rpc error: code = NotFound desc = could not find container \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": container with ID starting with 88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48 not found: ID does not exist" Jul 09 16:09:53.853536 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.853454 2581 scope.go:117] "RemoveContainer" containerID="6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73" Jul 09 16:09:53.853709 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.853693 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73"} err="failed to get container status \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": rpc error: code = NotFound desc = could not find container \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": container with ID starting with 6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73 not found: ID does not exist" Jul 09 16:09:53.853748 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.853711 2581 scope.go:117] "RemoveContainer" containerID="e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5" Jul 09 16:09:53.853934 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.853917 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5"} err="failed to get container status \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": rpc error: code = NotFound desc = could not find container \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": container with ID starting with e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5 not found: ID does not exist" Jul 09 16:09:53.853977 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.853936 2581 scope.go:117] "RemoveContainer" containerID="b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d" Jul 09 16:09:53.854142 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.854125 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d"} err="failed to get container status \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": rpc error: code = NotFound desc = could not find container \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": container with ID starting with b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d not found: ID does not exist" Jul 09 16:09:53.854192 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.854142 2581 scope.go:117] "RemoveContainer" containerID="27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77" Jul 09 16:09:53.854339 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.854322 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77"} err="failed to get container status \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": rpc error: code = NotFound desc = could not find container \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": container with ID starting with 27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77 not found: ID does not exist" Jul 09 16:09:53.854339 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.854338 2581 scope.go:117] "RemoveContainer" containerID="29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a" Jul 09 16:09:53.854551 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.854535 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a"} err="failed to get container status \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": rpc error: code = NotFound desc = could not find container \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": container with ID starting with 29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a not found: ID does not exist" Jul 09 16:09:53.854603 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.854552 2581 scope.go:117] "RemoveContainer" containerID="a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d" Jul 09 16:09:53.854775 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.854753 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d"} err="failed to get container status \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": rpc error: code = NotFound desc = could not find container \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": container with ID starting with a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d not found: ID does not exist" Jul 09 16:09:53.854775 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.854774 2581 scope.go:117] "RemoveContainer" containerID="88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48" Jul 09 16:09:53.855000 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.854983 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48"} err="failed to get container status \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": rpc error: code = NotFound desc = could not find container \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": container with ID starting with 88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48 not found: ID does not exist" Jul 09 16:09:53.855046 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.855000 2581 scope.go:117] "RemoveContainer" containerID="6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73" Jul 09 16:09:53.855205 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.855188 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73"} err="failed to get container status \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": rpc error: code = NotFound desc = could not find container \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": container with ID starting with 6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73 not found: ID does not exist" Jul 09 16:09:53.855243 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.855205 2581 scope.go:117] "RemoveContainer" containerID="e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5" Jul 09 16:09:53.855442 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.855412 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5"} err="failed to get container status \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": rpc error: code = NotFound desc = could not find container \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": container with ID starting with e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5 not found: ID does not exist" Jul 09 16:09:53.855539 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.855444 2581 scope.go:117] "RemoveContainer" containerID="b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d" Jul 09 16:09:53.855539 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.855485 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.855909 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.855674 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d"} err="failed to get container status \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": rpc error: code = NotFound desc = could not find container \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": container with ID starting with b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d not found: ID does not exist" Jul 09 16:09:53.855909 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.855697 2581 scope.go:117] "RemoveContainer" containerID="27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77" Jul 09 16:09:53.856106 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.856085 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77"} err="failed to get container status \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": rpc error: code = NotFound desc = could not find container \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": container with ID starting with 27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77 not found: ID does not exist" Jul 09 16:09:53.856158 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.856108 2581 scope.go:117] "RemoveContainer" containerID="29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a" Jul 09 16:09:53.856358 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.856338 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a"} err="failed to get container status \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": rpc error: code = NotFound desc = could not find container \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": container with ID starting with 29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a not found: ID does not exist" Jul 09 16:09:53.856408 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.856360 2581 scope.go:117] "RemoveContainer" containerID="a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d" Jul 09 16:09:53.856616 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.856598 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d"} err="failed to get container status \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": rpc error: code = NotFound desc = could not find container \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": container with ID starting with a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d not found: ID does not exist" Jul 09 16:09:53.856616 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.856615 2581 scope.go:117] "RemoveContainer" containerID="88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48" Jul 09 16:09:53.856838 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.856820 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48"} err="failed to get container status \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": rpc error: code = NotFound desc = could not find container \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": container with ID starting with 88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48 not found: ID does not exist" Jul 09 16:09:53.856838 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.856837 2581 scope.go:117] "RemoveContainer" containerID="6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73" Jul 09 16:09:53.857022 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.857004 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73"} err="failed to get container status \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": rpc error: code = NotFound desc = could not find container \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": container with ID starting with 6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73 not found: ID does not exist" Jul 09 16:09:53.857022 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.857019 2581 scope.go:117] "RemoveContainer" containerID="e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5" Jul 09 16:09:53.857240 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.857224 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5"} err="failed to get container status \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": rpc error: code = NotFound desc = could not find container \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": container with ID starting with e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5 not found: ID does not exist" Jul 09 16:09:53.857290 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.857250 2581 scope.go:117] "RemoveContainer" containerID="b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d" Jul 09 16:09:53.857455 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.857436 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d"} err="failed to get container status \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": rpc error: code = NotFound desc = could not find container \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": container with ID starting with b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d not found: ID does not exist" Jul 09 16:09:53.857572 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.857457 2581 scope.go:117] "RemoveContainer" containerID="27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77" Jul 09 16:09:53.857689 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.857671 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77"} err="failed to get container status \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": rpc error: code = NotFound desc = could not find container \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": container with ID starting with 27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77 not found: ID does not exist" Jul 09 16:09:53.857825 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.857691 2581 scope.go:117] "RemoveContainer" containerID="29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a" Jul 09 16:09:53.857924 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.857901 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a"} err="failed to get container status \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": rpc error: code = NotFound desc = could not find container \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": container with ID starting with 29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a not found: ID does not exist" Jul 09 16:09:53.857924 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.857913 2581 scope.go:117] "RemoveContainer" containerID="a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d" Jul 09 16:09:53.858146 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858117 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d"} err="failed to get container status \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": rpc error: code = NotFound desc = could not find container \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": container with ID starting with a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d not found: ID does not exist" Jul 09 16:09:53.858146 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858134 2581 scope.go:117] "RemoveContainer" containerID="88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48" Jul 09 16:09:53.858292 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858264 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-klx5x\"" Jul 09 16:09:53.858415 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858385 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48"} err="failed to get container status \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": rpc error: code = NotFound desc = could not find container \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": container with ID starting with 88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48 not found: ID does not exist" Jul 09 16:09:53.858415 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858409 2581 scope.go:117] "RemoveContainer" containerID="6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73" Jul 09 16:09:53.858615 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858568 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8kmhvmociintd\"" Jul 09 16:09:53.858702 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858572 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 16:09:53.858762 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858696 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73"} err="failed to get container status \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": rpc error: code = NotFound desc = could not find container \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": container with ID starting with 6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73 not found: ID does not exist" Jul 09 16:09:53.858762 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858718 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 16:09:53.858762 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858745 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 16:09:53.859035 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858787 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 16:09:53.859035 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858796 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 16:09:53.859035 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858719 2581 scope.go:117] "RemoveContainer" containerID="e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5" Jul 09 16:09:53.859035 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858808 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 16:09:53.859035 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.858876 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 16:09:53.859340 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859087 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5"} err="failed to get container status \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": rpc error: code = NotFound desc = could not find container \"e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5\": container with ID starting with e6edc1086e3491eb1569e41db6ecadfe724e594418d9a3016e2efd09f6493db5 not found: ID does not exist" Jul 09 16:09:53.859340 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859111 2581 scope.go:117] "RemoveContainer" containerID="b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d" Jul 09 16:09:53.859340 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859235 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 16:09:53.859340 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859293 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 16:09:53.859340 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859323 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 16:09:53.859340 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859326 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 16:09:53.859790 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859333 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 16:09:53.859790 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859454 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d"} err="failed to get container status \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": rpc error: code = NotFound desc = could not find container \"b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d\": container with ID starting with b6d6b79ef6cd73569c1286a47ce0010285a7a85d08b4c44bfda8baea4807007d not found: ID does not exist" Jul 09 16:09:53.859790 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859495 2581 scope.go:117] "RemoveContainer" containerID="27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77" Jul 09 16:09:53.859790 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859626 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 16:09:53.859790 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859728 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77"} err="failed to get container status \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": rpc error: code = NotFound desc = could not find container \"27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77\": container with ID starting with 27d5e3dbd0ea58ce207948d2a634e9276fefdf8d11b5e1e1596acbb89b31fe77 not found: ID does not exist" Jul 09 16:09:53.859790 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859751 2581 scope.go:117] "RemoveContainer" containerID="29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a" Jul 09 16:09:53.860060 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859976 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a"} err="failed to get container status \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": rpc error: code = NotFound desc = could not find container \"29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a\": container with ID starting with 29899df6ca0d9c290ab91539d80cc436adad0dff539eb1dd17c70bb7cc51a25a not found: ID does not exist" Jul 09 16:09:53.860060 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.859999 2581 scope.go:117] "RemoveContainer" containerID="a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d" Jul 09 16:09:53.860340 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.860305 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d"} err="failed to get container status \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": rpc error: code = NotFound desc = could not find container \"a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d\": container with ID starting with a57741e27caca2f0bf7012dd25473f3c618e0537362775942f355669f2ad875d not found: ID does not exist" Jul 09 16:09:53.860436 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.860341 2581 scope.go:117] "RemoveContainer" containerID="88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48" Jul 09 16:09:53.860662 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.860634 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48"} err="failed to get container status \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": rpc error: code = NotFound desc = could not find container \"88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48\": container with ID starting with 88cd5403469645008734c9e94aae7053bda4c856934cea4412b9dc47fc8daa48 not found: ID does not exist" Jul 09 16:09:53.860749 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.860663 2581 scope.go:117] "RemoveContainer" containerID="6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73" Jul 09 16:09:53.861004 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.860978 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73"} err="failed to get container status \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": rpc error: code = NotFound desc = could not find container \"6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73\": container with ID starting with 6b111ca00e511e4475127c5f35b75ba82ee6863d7cc7ec654cbe6fb1f547ef73 not found: ID does not exist" Jul 09 16:09:53.869093 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.866068 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 16:09:53.870878 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.870854 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:09:53.872081 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.872061 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 16:09:53.920968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.920928 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.920968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.920968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.920989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921156 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921542 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921542 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921542 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921542 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921542 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921542 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921542 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921542 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlqrz\" (UniqueName: \"kubernetes.io/projected/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-kube-api-access-nlqrz\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921542 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921844 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-config\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:53.921844 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:53.921603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.022851 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.022807 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.022851 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.022857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.023098 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.022885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.023098 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.022903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.023098 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.022924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.023098 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.022948 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.023098 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.022978 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.023098 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.023011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.023098 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.023041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.023098 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.023095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.023538 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.023460 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.023957 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.023929 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.023957 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.023943 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.024122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.023975 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.024122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.023999 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlqrz\" (UniqueName: \"kubernetes.io/projected/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-kube-api-access-nlqrz\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.024122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.024057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.024122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.024093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-config\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.024304 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.024132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.024304 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.024164 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.024304 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.024205 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.024304 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.024231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.024304 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.024263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.024304 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.024291 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.024622 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.024329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.026109 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.026075 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.026109 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.026103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.026297 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.026215 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.026802 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.026720 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.026802 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.026812 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.027869 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.027122 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.027869 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.027186 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.027869 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.027287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.027869 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.027423 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.027869 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.027858 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.028757 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.028729 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.028959 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.028934 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.029070 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.029054 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.029284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.029264 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-config\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.030073 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.030055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.033219 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.033195 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlqrz\" (UniqueName: \"kubernetes.io/projected/2d74c20f-e8d6-4cb9-af76-0e689292d1f1-kube-api-access-nlqrz\") pod \"prometheus-k8s-0\" (UID: \"2d74c20f-e8d6-4cb9-af76-0e689292d1f1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.167386 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.167345 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:09:54.307688 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.307616 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:09:54.313085 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:09:54.311919 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d74c20f_e8d6_4cb9_af76_0e689292d1f1.slice/crio-8fb76ea742ab2429cf3404595317ab7431bf841a98002bb9bb647a8b3d337fb3 WatchSource:0}: Error finding container 8fb76ea742ab2429cf3404595317ab7431bf841a98002bb9bb647a8b3d337fb3: Status 404 returned error can't find the container with id 8fb76ea742ab2429cf3404595317ab7431bf841a98002bb9bb647a8b3d337fb3 Jul 09 16:09:54.801965 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.801932 2581 generic.go:356] "Generic (PLEG): container finished" podID="2d74c20f-e8d6-4cb9-af76-0e689292d1f1" containerID="fea3f3735bcb41494ce253420682cd0cfceaf3982265958d0541bd5ec0878db9" exitCode=0 Jul 09 16:09:54.802436 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.802012 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d74c20f-e8d6-4cb9-af76-0e689292d1f1","Type":"ContainerDied","Data":"fea3f3735bcb41494ce253420682cd0cfceaf3982265958d0541bd5ec0878db9"} Jul 09 16:09:54.802436 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:54.802076 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d74c20f-e8d6-4cb9-af76-0e689292d1f1","Type":"ContainerStarted","Data":"8fb76ea742ab2429cf3404595317ab7431bf841a98002bb9bb647a8b3d337fb3"} Jul 09 16:09:55.510229 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:55.510192 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4af49315-0808-4eec-9900-b8ff00c00f94" path="/var/lib/kubelet/pods/4af49315-0808-4eec-9900-b8ff00c00f94/volumes" Jul 09 16:09:55.809031 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:55.808948 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d74c20f-e8d6-4cb9-af76-0e689292d1f1","Type":"ContainerStarted","Data":"59cfa6f191b52223cbac0a3e2e8642cd36fcaa90afe02eabf1a392a1555ca6e7"} Jul 09 16:09:55.809419 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:55.809057 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d74c20f-e8d6-4cb9-af76-0e689292d1f1","Type":"ContainerStarted","Data":"2fef8853b7902564b12506bf81734e1b0140939a7922d354e29fe2187bc1381c"} Jul 09 16:09:55.809419 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:55.809097 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d74c20f-e8d6-4cb9-af76-0e689292d1f1","Type":"ContainerStarted","Data":"b9b13f82f2305edbfe9cf0ec2c375c094304d934b32b05dcb857b56fb0526568"} Jul 09 16:09:55.809419 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:55.809138 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d74c20f-e8d6-4cb9-af76-0e689292d1f1","Type":"ContainerStarted","Data":"23bfb54118ce03b24da02a8f2e887bec415a334c4cef048fc32e3e26fe4a1ea1"} Jul 09 16:09:55.809419 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:55.809178 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d74c20f-e8d6-4cb9-af76-0e689292d1f1","Type":"ContainerStarted","Data":"15cef6333f8834ccb79ab27cf3520cac771ddcd41d196dbf853cb38312012cae"} Jul 09 16:09:55.809419 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:55.809212 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d74c20f-e8d6-4cb9-af76-0e689292d1f1","Type":"ContainerStarted","Data":"ecfb6ad3b0e7f09f6d127e51c272f0533806571a2c83f0f11e2710121d5632e3"} Jul 09 16:09:55.846104 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:55.846053 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.830178049 podStartE2EDuration="2.846038173s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.860124ms" isStatefulPod=false podCreationTimestamp="2026-07-09 16:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:09:55.843355624 +0000 UTC m=+372.914951624" watchObservedRunningTime="2026-07-09 16:09:55.846038173 +0000 UTC m=+372.917634123" Jul 09 16:09:57.354758 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:57.354689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:09:57.357205 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:57.357173 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c284a-ea51-4053-9d3e-32524736479b-metrics-certs\") pod \"network-metrics-daemon-k74h8\" (UID: \"865c284a-ea51-4053-9d3e-32524736479b\") " pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:09:57.609141 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:57.609064 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gdktf\"" Jul 09 16:09:57.616233 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:57.616213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k74h8" Jul 09 16:09:57.747236 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:57.747212 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k74h8"] Jul 09 16:09:57.749538 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:09:57.749512 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865c284a_ea51_4053_9d3e_32524736479b.slice/crio-e7cb45aa25c589a0b8177efda0312ca272f9bbcc3e3a6950359efa8c13c020ff WatchSource:0}: Error finding container e7cb45aa25c589a0b8177efda0312ca272f9bbcc3e3a6950359efa8c13c020ff: Status 404 returned error can't find the container with id e7cb45aa25c589a0b8177efda0312ca272f9bbcc3e3a6950359efa8c13c020ff Jul 09 16:09:57.751647 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:57.751629 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:09:57.818985 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:57.818949 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k74h8" event={"ID":"865c284a-ea51-4053-9d3e-32524736479b","Type":"ContainerStarted","Data":"e7cb45aa25c589a0b8177efda0312ca272f9bbcc3e3a6950359efa8c13c020ff"} Jul 09 16:09:58.830066 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:58.830032 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k74h8" event={"ID":"865c284a-ea51-4053-9d3e-32524736479b","Type":"ContainerStarted","Data":"2d75970fb13124669b3ae55eb9830c532904bcfbb2d1df59c5c96b9671541bb1"} Jul 09 16:09:58.830500 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:58.830116 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k74h8" event={"ID":"865c284a-ea51-4053-9d3e-32524736479b","Type":"ContainerStarted","Data":"fe19052ce3b7a3dadcaedb6f24d3d62cf90c640f3c811b200f152992c53cdbdf"} Jul 09 16:09:58.846531 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:58.846405 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k74h8" podStartSLOduration=375.012128659 podStartE2EDuration="6m15.846379048s" totalImagesPullingTime="834.250389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:09:58.845496432 +0000 UTC m=+375.917092399" watchObservedRunningTime="2026-07-09 16:09:58.846379048 +0000 UTC m=+375.917974998" Jul 09 16:09:59.167849 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:09:59.167810 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:10:54.167883 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:10:54.167849 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:10:54.183883 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:10:54.183855 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:10:55.070759 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:10:55.070732 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:13:04.212939 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.212903 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7sglw"] Jul 09 16:13:04.216214 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.216195 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" Jul 09 16:13:04.219436 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.219417 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 16:13:04.220785 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.220767 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jvvfq\"" Jul 09 16:13:04.221036 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.221010 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 16:13:04.225272 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.225254 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7sglw"] Jul 09 16:13:04.287276 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.287240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5297585f-5d76-432f-9d0a-173fefcc81dc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7sglw\" (UID: \"5297585f-5d76-432f-9d0a-173fefcc81dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" Jul 09 16:13:04.287478 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.287379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpjh9\" (UniqueName: \"kubernetes.io/projected/5297585f-5d76-432f-9d0a-173fefcc81dc-kube-api-access-zpjh9\") pod \"cert-manager-webhook-6486ffd997-7sglw\" (UID: \"5297585f-5d76-432f-9d0a-173fefcc81dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" Jul 09 16:13:04.387787 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.387749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5297585f-5d76-432f-9d0a-173fefcc81dc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7sglw\" (UID: \"5297585f-5d76-432f-9d0a-173fefcc81dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" Jul 09 16:13:04.387997 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.387839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpjh9\" (UniqueName: \"kubernetes.io/projected/5297585f-5d76-432f-9d0a-173fefcc81dc-kube-api-access-zpjh9\") pod \"cert-manager-webhook-6486ffd997-7sglw\" (UID: \"5297585f-5d76-432f-9d0a-173fefcc81dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" Jul 09 16:13:04.397020 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.396990 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5297585f-5d76-432f-9d0a-173fefcc81dc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7sglw\" (UID: \"5297585f-5d76-432f-9d0a-173fefcc81dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" Jul 09 16:13:04.397260 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.397238 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpjh9\" (UniqueName: \"kubernetes.io/projected/5297585f-5d76-432f-9d0a-173fefcc81dc-kube-api-access-zpjh9\") pod \"cert-manager-webhook-6486ffd997-7sglw\" (UID: \"5297585f-5d76-432f-9d0a-173fefcc81dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" Jul 09 16:13:04.536251 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.536155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" Jul 09 16:13:04.665686 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:04.665572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7sglw"] Jul 09 16:13:04.668034 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:13:04.668003 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5297585f_5d76_432f_9d0a_173fefcc81dc.slice/crio-d23debd16eca58cb7c89078b907a37cf829571139760327efd1a4483dea517a4 WatchSource:0}: Error finding container d23debd16eca58cb7c89078b907a37cf829571139760327efd1a4483dea517a4: Status 404 returned error can't find the container with id d23debd16eca58cb7c89078b907a37cf829571139760327efd1a4483dea517a4 Jul 09 16:13:05.568446 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:05.568406 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" event={"ID":"5297585f-5d76-432f-9d0a-173fefcc81dc","Type":"ContainerStarted","Data":"d23debd16eca58cb7c89078b907a37cf829571139760327efd1a4483dea517a4"} Jul 09 16:13:08.583258 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:08.583225 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" event={"ID":"5297585f-5d76-432f-9d0a-173fefcc81dc","Type":"ContainerStarted","Data":"b4785c06f33bcfd482f5e86ed765f2d1a54ef8a8f72d03dd7b650602222a4b00"} Jul 09 16:13:08.583651 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:08.583364 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" Jul 09 16:13:08.601340 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:08.601285 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" podStartSLOduration=0.84511074 podStartE2EDuration="4.60127098s" totalImagesPullingTime="3.75616024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:13:08.600490525 +0000 UTC m=+565.672086469" watchObservedRunningTime="2026-07-09 16:13:08.60127098 +0000 UTC m=+565.672866930" Jul 09 16:13:14.590280 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:14.590247 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7sglw" Jul 09 16:13:43.350739 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.350706 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85695d7677-92kln"] Jul 09 16:13:43.354005 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.353985 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.359349 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.359327 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:13:43.359510 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.359330 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 16:13:43.359595 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.359365 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 16:13:43.359595 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.359520 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 16:13:43.359708 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.359445 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 16:13:43.359708 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.359444 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qgljl\"" Jul 09 16:13:43.373970 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.373934 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85695d7677-92kln"] Jul 09 16:13:43.408120 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.408094 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:13:43.409387 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.409366 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:13:43.415769 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.415747 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8372755f-9544-4bda-9acb-577a471d2755-metrics-cert\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.415903 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.415787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8372755f-9544-4bda-9acb-577a471d2755-manager-config\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.415903 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.415836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h486q\" (UniqueName: \"kubernetes.io/projected/8372755f-9544-4bda-9acb-577a471d2755-kube-api-access-h486q\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.415903 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.415856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8372755f-9544-4bda-9acb-577a471d2755-cert\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.516975 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.516875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8372755f-9544-4bda-9acb-577a471d2755-manager-config\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.516975 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.516930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h486q\" (UniqueName: \"kubernetes.io/projected/8372755f-9544-4bda-9acb-577a471d2755-kube-api-access-h486q\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.516975 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.516966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8372755f-9544-4bda-9acb-577a471d2755-cert\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.522196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.517009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8372755f-9544-4bda-9acb-577a471d2755-metrics-cert\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.522196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.517570 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8372755f-9544-4bda-9acb-577a471d2755-manager-config\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.522196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.519495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8372755f-9544-4bda-9acb-577a471d2755-metrics-cert\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.522196 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.519533 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8372755f-9544-4bda-9acb-577a471d2755-cert\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.527556 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.527509 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h486q\" (UniqueName: \"kubernetes.io/projected/8372755f-9544-4bda-9acb-577a471d2755-kube-api-access-h486q\") pod \"lws-controller-manager-85695d7677-92kln\" (UID: \"8372755f-9544-4bda-9acb-577a471d2755\") " pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.665065 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.665037 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:13:43.813947 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:43.813922 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85695d7677-92kln"] Jul 09 16:13:43.816436 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:13:43.816408 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8372755f_9544_4bda_9acb_577a471d2755.slice/crio-6a0a0984b8839cc17584268105b265ed943e2bec21ca5372fd5abcfa53cd41d4 WatchSource:0}: Error finding container 6a0a0984b8839cc17584268105b265ed943e2bec21ca5372fd5abcfa53cd41d4: Status 404 returned error can't find the container with id 6a0a0984b8839cc17584268105b265ed943e2bec21ca5372fd5abcfa53cd41d4 Jul 09 16:13:44.728168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:44.728132 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" event={"ID":"8372755f-9544-4bda-9acb-577a471d2755","Type":"ContainerStarted","Data":"6a0a0984b8839cc17584268105b265ed943e2bec21ca5372fd5abcfa53cd41d4"} Jul 09 16:13:46.753209 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.753182 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb"] Jul 09 16:13:46.756566 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.756547 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.759723 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.759697 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 16:13:46.759858 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.759811 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 16:13:46.759858 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.759826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s4zxx\"" Jul 09 16:13:46.760052 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.760039 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 16:13:46.760141 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.760125 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 16:13:46.776014 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.775988 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb"] Jul 09 16:13:46.844838 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.844799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9efadeea-0e99-448e-a2d3-ae5238b82748-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.844998 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.844866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shz8v\" (UniqueName: \"kubernetes.io/projected/9efadeea-0e99-448e-a2d3-ae5238b82748-kube-api-access-shz8v\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.844998 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.844902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9efadeea-0e99-448e-a2d3-ae5238b82748-manifests\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.844998 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.844919 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9efadeea-0e99-448e-a2d3-ae5238b82748-tmp\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.844998 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.844937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9efadeea-0e99-448e-a2d3-ae5238b82748-webhook-cert\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.946229 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.946187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9efadeea-0e99-448e-a2d3-ae5238b82748-manifests\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.946229 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.946229 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9efadeea-0e99-448e-a2d3-ae5238b82748-tmp\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.946429 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.946254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9efadeea-0e99-448e-a2d3-ae5238b82748-webhook-cert\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.946429 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.946311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9efadeea-0e99-448e-a2d3-ae5238b82748-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.946429 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.946378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shz8v\" (UniqueName: \"kubernetes.io/projected/9efadeea-0e99-448e-a2d3-ae5238b82748-kube-api-access-shz8v\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.946710 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.946685 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9efadeea-0e99-448e-a2d3-ae5238b82748-manifests\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.948813 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.948787 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9efadeea-0e99-448e-a2d3-ae5238b82748-tmp\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.949157 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.949122 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9efadeea-0e99-448e-a2d3-ae5238b82748-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.949270 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.949130 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9efadeea-0e99-448e-a2d3-ae5238b82748-webhook-cert\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:46.954810 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:46.954787 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shz8v\" (UniqueName: \"kubernetes.io/projected/9efadeea-0e99-448e-a2d3-ae5238b82748-kube-api-access-shz8v\") pod \"opendatahub-operator-controller-manager-757d6df76f-rsgmb\" (UID: \"9efadeea-0e99-448e-a2d3-ae5238b82748\") " pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:47.068206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:47.068129 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:47.235785 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:47.235746 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb"] Jul 09 16:13:47.239654 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:13:47.239627 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9efadeea_0e99_448e_a2d3_ae5238b82748.slice/crio-ab740e741f830852d4342dd689d1eec1fa52eb90f10471b832630069c93bbba9 WatchSource:0}: Error finding container ab740e741f830852d4342dd689d1eec1fa52eb90f10471b832630069c93bbba9: Status 404 returned error can't find the container with id ab740e741f830852d4342dd689d1eec1fa52eb90f10471b832630069c93bbba9 Jul 09 16:13:47.743191 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:47.743154 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" event={"ID":"9efadeea-0e99-448e-a2d3-ae5238b82748","Type":"ContainerStarted","Data":"ab740e741f830852d4342dd689d1eec1fa52eb90f10471b832630069c93bbba9"} Jul 09 16:13:50.762997 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:50.762905 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" event={"ID":"9efadeea-0e99-448e-a2d3-ae5238b82748","Type":"ContainerStarted","Data":"2fff28afcf802bd98230c7cb1d7767fcf8f2e3a03102be45419eecee033c5ffe"} Jul 09 16:13:51.768885 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:51.768849 2581 generic.go:356] "Generic (PLEG): container finished" podID="9efadeea-0e99-448e-a2d3-ae5238b82748" containerID="2fff28afcf802bd98230c7cb1d7767fcf8f2e3a03102be45419eecee033c5ffe" exitCode=0 Jul 09 16:13:51.769246 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:51.768891 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" event={"ID":"9efadeea-0e99-448e-a2d3-ae5238b82748","Type":"ContainerDied","Data":"2fff28afcf802bd98230c7cb1d7767fcf8f2e3a03102be45419eecee033c5ffe"} Jul 09 16:13:53.779245 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:53.779205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" event={"ID":"9efadeea-0e99-448e-a2d3-ae5238b82748","Type":"ContainerStarted","Data":"0eccfc72250b064ccd9a10dd7917ecc34be87d91ca1ec4373a8c495bb152d5b4"} Jul 09 16:13:53.779758 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:53.779331 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:13:53.802962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:13:53.802913 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" podStartSLOduration=2.526733995 podStartE2EDuration="7.802896376s" totalImagesPullingTime="4.236049073s" totalInitContainerRuntime="1.040113308s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:13:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:13:53.800268481 +0000 UTC m=+610.871864433" watchObservedRunningTime="2026-07-09 16:13:53.802896376 +0000 UTC m=+610.874492326" Jul 09 16:14:01.817330 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:01.817295 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" event={"ID":"8372755f-9544-4bda-9acb-577a471d2755","Type":"ContainerStarted","Data":"8a89897572e13f08d45c50776eecc6a9a0f7befdc2ed802430c66d7ad28ca77c"} Jul 09 16:14:01.817754 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:01.817425 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:14:01.834134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:01.834086 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" podStartSLOduration=1.7392451740000001 podStartE2EDuration="18.834070294s" totalImagesPullingTime="17.09482512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:14:01.832914603 +0000 UTC m=+618.904510553" watchObservedRunningTime="2026-07-09 16:14:01.834070294 +0000 UTC m=+618.905666244" Jul 09 16:14:04.785960 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:04.785877 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-757d6df76f-rsgmb" Jul 09 16:14:07.053976 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.053932 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl"] Jul 09 16:14:07.057437 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.057418 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:07.061170 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.061134 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 16:14:07.061317 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.061300 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 16:14:07.061394 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.061348 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 16:14:07.062940 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.062916 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 16:14:07.063088 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.063043 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4mtv2\"" Jul 09 16:14:07.072378 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.072357 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl"] Jul 09 16:14:07.126087 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.126054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ccx6\" (UniqueName: \"kubernetes.io/projected/4ef98b78-59a2-4778-a12d-63f292e6de04-kube-api-access-9ccx6\") pod \"kube-auth-proxy-566b87dd6c-h97wl\" (UID: \"4ef98b78-59a2-4778-a12d-63f292e6de04\") " pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:07.126267 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.126097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ef98b78-59a2-4778-a12d-63f292e6de04-tmp\") pod \"kube-auth-proxy-566b87dd6c-h97wl\" (UID: \"4ef98b78-59a2-4778-a12d-63f292e6de04\") " pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:07.126267 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.126118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef98b78-59a2-4778-a12d-63f292e6de04-tls-certs\") pod \"kube-auth-proxy-566b87dd6c-h97wl\" (UID: \"4ef98b78-59a2-4778-a12d-63f292e6de04\") " pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:07.227582 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.227548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef98b78-59a2-4778-a12d-63f292e6de04-tls-certs\") pod \"kube-auth-proxy-566b87dd6c-h97wl\" (UID: \"4ef98b78-59a2-4778-a12d-63f292e6de04\") " pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:07.227746 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.227636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ccx6\" (UniqueName: \"kubernetes.io/projected/4ef98b78-59a2-4778-a12d-63f292e6de04-kube-api-access-9ccx6\") pod \"kube-auth-proxy-566b87dd6c-h97wl\" (UID: \"4ef98b78-59a2-4778-a12d-63f292e6de04\") " pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:07.227746 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.227691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ef98b78-59a2-4778-a12d-63f292e6de04-tmp\") pod \"kube-auth-proxy-566b87dd6c-h97wl\" (UID: \"4ef98b78-59a2-4778-a12d-63f292e6de04\") " pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:07.227746 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:14:07.227707 2581 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 09 16:14:07.227875 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:14:07.227795 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef98b78-59a2-4778-a12d-63f292e6de04-tls-certs podName:4ef98b78-59a2-4778-a12d-63f292e6de04 nodeName:}" failed. No retries permitted until 2026-07-09 16:14:07.727772533 +0000 UTC m=+624.799368462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4ef98b78-59a2-4778-a12d-63f292e6de04-tls-certs") pod "kube-auth-proxy-566b87dd6c-h97wl" (UID: "4ef98b78-59a2-4778-a12d-63f292e6de04") : secret "kube-auth-proxy-tls" not found Jul 09 16:14:07.229975 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.229955 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ef98b78-59a2-4778-a12d-63f292e6de04-tmp\") pod \"kube-auth-proxy-566b87dd6c-h97wl\" (UID: \"4ef98b78-59a2-4778-a12d-63f292e6de04\") " pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:07.239735 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.239713 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ccx6\" (UniqueName: \"kubernetes.io/projected/4ef98b78-59a2-4778-a12d-63f292e6de04-kube-api-access-9ccx6\") pod \"kube-auth-proxy-566b87dd6c-h97wl\" (UID: \"4ef98b78-59a2-4778-a12d-63f292e6de04\") " pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:07.733041 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.733007 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef98b78-59a2-4778-a12d-63f292e6de04-tls-certs\") pod \"kube-auth-proxy-566b87dd6c-h97wl\" (UID: \"4ef98b78-59a2-4778-a12d-63f292e6de04\") " pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:07.735572 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.735546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef98b78-59a2-4778-a12d-63f292e6de04-tls-certs\") pod \"kube-auth-proxy-566b87dd6c-h97wl\" (UID: \"4ef98b78-59a2-4778-a12d-63f292e6de04\") " pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:07.967594 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:07.967555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" Jul 09 16:14:08.103336 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:08.103314 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl"] Jul 09 16:14:08.105722 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:14:08.105690 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef98b78_59a2_4778_a12d_63f292e6de04.slice/crio-1bc3cf5a050790640f978c68e0cda4d3e2ef714a62cbff5c66c4495beddff5f1 WatchSource:0}: Error finding container 1bc3cf5a050790640f978c68e0cda4d3e2ef714a62cbff5c66c4495beddff5f1: Status 404 returned error can't find the container with id 1bc3cf5a050790640f978c68e0cda4d3e2ef714a62cbff5c66c4495beddff5f1 Jul 09 16:14:08.849154 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:08.849117 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" event={"ID":"4ef98b78-59a2-4778-a12d-63f292e6de04","Type":"ContainerStarted","Data":"1bc3cf5a050790640f978c68e0cda4d3e2ef714a62cbff5c66c4495beddff5f1"} Jul 09 16:14:12.824239 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:12.824205 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85695d7677-92kln" Jul 09 16:14:12.868869 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:12.868832 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" event={"ID":"4ef98b78-59a2-4778-a12d-63f292e6de04","Type":"ContainerStarted","Data":"2de880380110339aa8d3fd4c5c5b0cf519a8e574393bddb32d31df275074ff97"} Jul 09 16:14:12.885981 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:14:12.885923 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-566b87dd6c-h97wl" podStartSLOduration=2.142397274 podStartE2EDuration="5.88590752s" totalImagesPullingTime="3.743510246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:14:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:14:12.884002315 +0000 UTC m=+629.955598266" watchObservedRunningTime="2026-07-09 16:14:12.88590752 +0000 UTC m=+629.957503470" Jul 09 16:16:02.158184 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.158149 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-628jw"] Jul 09 16:16:02.161624 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.161604 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:02.164543 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.164501 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 09 16:16:02.164667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.164545 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 16:16:02.164667 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.164526 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b82xm\"" Jul 09 16:16:02.165899 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.165879 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 09 16:16:02.166001 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.165959 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 16:16:02.169865 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.169846 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-628jw"] Jul 09 16:16:02.318306 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.318270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n28r7\" (UniqueName: \"kubernetes.io/projected/1d604d8c-e91e-47da-97b2-d29d8aa03901-kube-api-access-n28r7\") pod \"kuadrant-console-plugin-66b5774985-628jw\" (UID: \"1d604d8c-e91e-47da-97b2-d29d8aa03901\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:02.318517 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.318343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d604d8c-e91e-47da-97b2-d29d8aa03901-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-628jw\" (UID: \"1d604d8c-e91e-47da-97b2-d29d8aa03901\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:02.318517 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.318362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d604d8c-e91e-47da-97b2-d29d8aa03901-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-628jw\" (UID: \"1d604d8c-e91e-47da-97b2-d29d8aa03901\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:02.419431 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.419332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d604d8c-e91e-47da-97b2-d29d8aa03901-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-628jw\" (UID: \"1d604d8c-e91e-47da-97b2-d29d8aa03901\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:02.419431 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.419368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d604d8c-e91e-47da-97b2-d29d8aa03901-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-628jw\" (UID: \"1d604d8c-e91e-47da-97b2-d29d8aa03901\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:02.419431 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.419408 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28r7\" (UniqueName: \"kubernetes.io/projected/1d604d8c-e91e-47da-97b2-d29d8aa03901-kube-api-access-n28r7\") pod \"kuadrant-console-plugin-66b5774985-628jw\" (UID: \"1d604d8c-e91e-47da-97b2-d29d8aa03901\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:02.419746 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:16:02.419530 2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 09 16:16:02.419746 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:16:02.419596 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d604d8c-e91e-47da-97b2-d29d8aa03901-plugin-serving-cert podName:1d604d8c-e91e-47da-97b2-d29d8aa03901 nodeName:}" failed. No retries permitted until 2026-07-09 16:16:02.919578367 +0000 UTC m=+739.991174299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/1d604d8c-e91e-47da-97b2-d29d8aa03901-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-628jw" (UID: "1d604d8c-e91e-47da-97b2-d29d8aa03901") : secret "plugin-serving-cert" not found Jul 09 16:16:02.419968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.419949 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d604d8c-e91e-47da-97b2-d29d8aa03901-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-628jw\" (UID: \"1d604d8c-e91e-47da-97b2-d29d8aa03901\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:02.429868 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.429840 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n28r7\" (UniqueName: \"kubernetes.io/projected/1d604d8c-e91e-47da-97b2-d29d8aa03901-kube-api-access-n28r7\") pod \"kuadrant-console-plugin-66b5774985-628jw\" (UID: \"1d604d8c-e91e-47da-97b2-d29d8aa03901\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:02.924119 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.924090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d604d8c-e91e-47da-97b2-d29d8aa03901-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-628jw\" (UID: \"1d604d8c-e91e-47da-97b2-d29d8aa03901\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:02.926634 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:02.926604 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d604d8c-e91e-47da-97b2-d29d8aa03901-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-628jw\" (UID: \"1d604d8c-e91e-47da-97b2-d29d8aa03901\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:03.071586 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:03.071552 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" Jul 09 16:16:03.205946 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:03.205882 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-628jw"] Jul 09 16:16:03.208374 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:16:03.208349 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d604d8c_e91e_47da_97b2_d29d8aa03901.slice/crio-6c1659d2ad56bbe499b5b6ac54bb79c6e190b58852e6e64d1ffdddfb0b7984e2 WatchSource:0}: Error finding container 6c1659d2ad56bbe499b5b6ac54bb79c6e190b58852e6e64d1ffdddfb0b7984e2: Status 404 returned error can't find the container with id 6c1659d2ad56bbe499b5b6ac54bb79c6e190b58852e6e64d1ffdddfb0b7984e2 Jul 09 16:16:03.209995 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:03.209980 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:16:03.373420 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:03.373382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" event={"ID":"1d604d8c-e91e-47da-97b2-d29d8aa03901","Type":"ContainerStarted","Data":"6c1659d2ad56bbe499b5b6ac54bb79c6e190b58852e6e64d1ffdddfb0b7984e2"} Jul 09 16:16:11.837656 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:11.837616 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg"] Jul 09 16:16:11.841572 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:11.841544 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:11.844696 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:11.844667 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cvhzc\"" Jul 09 16:16:11.857859 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:11.857834 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg"] Jul 09 16:16:12.010172 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.010131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" (UID: \"806d4c06-b1a4-4fcc-9e94-b0e773b59f6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:12.010355 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.010169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs255\" (UniqueName: \"kubernetes.io/projected/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-kube-api-access-xs255\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" (UID: \"806d4c06-b1a4-4fcc-9e94-b0e773b59f6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:12.111511 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.111389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" (UID: \"806d4c06-b1a4-4fcc-9e94-b0e773b59f6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:12.111511 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.111433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs255\" (UniqueName: \"kubernetes.io/projected/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-kube-api-access-xs255\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" (UID: \"806d4c06-b1a4-4fcc-9e94-b0e773b59f6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:12.111848 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.111828 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" (UID: \"806d4c06-b1a4-4fcc-9e94-b0e773b59f6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:12.120551 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.120524 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs255\" (UniqueName: \"kubernetes.io/projected/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-kube-api-access-xs255\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" (UID: \"806d4c06-b1a4-4fcc-9e94-b0e773b59f6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:12.154570 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.154548 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:12.335836 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.335802 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg"] Jul 09 16:16:12.338982 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:16:12.338952 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806d4c06_b1a4_4fcc_9e94_b0e773b59f6a.slice/crio-b020ddc65fb21b57283744e4d454f94ca88bb1af822f93ce4fadd7fa2d7ddc8d WatchSource:0}: Error finding container b020ddc65fb21b57283744e4d454f94ca88bb1af822f93ce4fadd7fa2d7ddc8d: Status 404 returned error can't find the container with id b020ddc65fb21b57283744e4d454f94ca88bb1af822f93ce4fadd7fa2d7ddc8d Jul 09 16:16:12.421415 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.421383 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" event={"ID":"806d4c06-b1a4-4fcc-9e94-b0e773b59f6a","Type":"ContainerStarted","Data":"b020ddc65fb21b57283744e4d454f94ca88bb1af822f93ce4fadd7fa2d7ddc8d"} Jul 09 16:16:12.575928 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.575886 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg"] Jul 09 16:16:12.580379 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.580356 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg"] Jul 09 16:16:12.600824 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.600789 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw"] Jul 09 16:16:12.605210 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.605187 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:12.621833 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.621808 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw"] Jul 09 16:16:12.717302 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.717215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5px6x\" (UniqueName: \"kubernetes.io/projected/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-kube-api-access-5px6x\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8pqsw\" (UID: \"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:12.717493 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.717381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8pqsw\" (UID: \"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:12.818405 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.818366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5px6x\" (UniqueName: \"kubernetes.io/projected/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-kube-api-access-5px6x\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8pqsw\" (UID: \"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:12.818607 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.818485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8pqsw\" (UID: \"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:12.818865 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.818841 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8pqsw\" (UID: \"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:12.827617 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.827593 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5px6x\" (UniqueName: \"kubernetes.io/projected/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-kube-api-access-5px6x\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8pqsw\" (UID: \"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:12.917764 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:12.917733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:27.307597 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:27.307574 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw"] Jul 09 16:16:27.309411 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:16:27.309387 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1885b5c7_3dcf_42cf_80d3_5e07470e1ea6.slice/crio-ad15cd0bdfc20b6a007313305b5ac446e798a528bbc7d31748a44b38e5dfdded WatchSource:0}: Error finding container ad15cd0bdfc20b6a007313305b5ac446e798a528bbc7d31748a44b38e5dfdded: Status 404 returned error can't find the container with id ad15cd0bdfc20b6a007313305b5ac446e798a528bbc7d31748a44b38e5dfdded Jul 09 16:16:27.502957 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:27.502855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" event={"ID":"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6","Type":"ContainerStarted","Data":"ad15cd0bdfc20b6a007313305b5ac446e798a528bbc7d31748a44b38e5dfdded"} Jul 09 16:16:27.504630 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:27.504599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" event={"ID":"1d604d8c-e91e-47da-97b2-d29d8aa03901","Type":"ContainerStarted","Data":"03c38878748b15f8ef4b8e48af8c9bcad259761e365235b514502c39874edb4b"} Jul 09 16:16:27.536924 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:27.536858 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-628jw" podStartSLOduration=1.494520173 podStartE2EDuration="25.53683942s" totalImagesPullingTime="24.042319247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:27.535984447 +0000 UTC m=+764.607580398" watchObservedRunningTime="2026-07-09 16:16:27.53683942 +0000 UTC m=+764.608435370" Jul 09 16:16:32.534151 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:32.534041 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" podUID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" containerName="manager" containerID="cri-o://788863a324d1a05ddb121530a50c6a7c28731592873aa6a263cb0a2056d791e6" gracePeriod=2 Jul 09 16:16:32.535604 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:32.535578 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" event={"ID":"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6","Type":"ContainerStarted","Data":"0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde"} Jul 09 16:16:32.535737 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:32.535713 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:32.536455 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:16:32.536426 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:32.538681 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:16:32.538500 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:32.559783 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:32.559725 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" podStartSLOduration=15.635678024 podStartE2EDuration="20.559706067s" totalImagesPullingTime="4.924028043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:16:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:32.559187969 +0000 UTC m=+769.630783964" watchObservedRunningTime="2026-07-09 16:16:32.559706067 +0000 UTC m=+769.631302027" Jul 09 16:16:32.767411 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:32.767389 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:32.769904 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:16:32.769876 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:32.804052 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:32.803981 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs255\" (UniqueName: \"kubernetes.io/projected/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-kube-api-access-xs255\") pod \"806d4c06-b1a4-4fcc-9e94-b0e773b59f6a\" (UID: \"806d4c06-b1a4-4fcc-9e94-b0e773b59f6a\") " Jul 09 16:16:32.804052 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:32.804031 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-extensions-socket-volume\") pod \"806d4c06-b1a4-4fcc-9e94-b0e773b59f6a\" (UID: \"806d4c06-b1a4-4fcc-9e94-b0e773b59f6a\") " Jul 09 16:16:32.804303 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:32.804281 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" (UID: "806d4c06-b1a4-4fcc-9e94-b0e773b59f6a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:16:32.804389 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:32.804375 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-extensions-socket-volume\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:16:32.806252 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:32.806232 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-kube-api-access-xs255" (OuterVolumeSpecName: "kube-api-access-xs255") pod "806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" (UID: "806d4c06-b1a4-4fcc-9e94-b0e773b59f6a"). InnerVolumeSpecName "kube-api-access-xs255". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:16:32.905773 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:32.905735 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs255\" (UniqueName: \"kubernetes.io/projected/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a-kube-api-access-xs255\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:16:33.509918 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:16:33.509834 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:33.511053 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:33.511033 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" path="/var/lib/kubelet/pods/806d4c06-b1a4-4fcc-9e94-b0e773b59f6a/volumes" Jul 09 16:16:33.541217 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:33.541186 2581 generic.go:356] "Generic (PLEG): container finished" podID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" containerID="788863a324d1a05ddb121530a50c6a7c28731592873aa6a263cb0a2056d791e6" exitCode=2 Jul 09 16:16:33.541691 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:33.541238 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:33.541691 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:33.541292 2581 scope.go:117] "RemoveContainer" containerID="788863a324d1a05ddb121530a50c6a7c28731592873aa6a263cb0a2056d791e6" Jul 09 16:16:33.544144 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:16:33.544114 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:33.546404 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:16:33.546382 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hl6zg\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hl6zg" Jul 09 16:16:33.550340 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:33.550325 2581 scope.go:117] "RemoveContainer" containerID="788863a324d1a05ddb121530a50c6a7c28731592873aa6a263cb0a2056d791e6" Jul 09 16:16:33.550615 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:16:33.550595 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"788863a324d1a05ddb121530a50c6a7c28731592873aa6a263cb0a2056d791e6\": container with ID starting with 788863a324d1a05ddb121530a50c6a7c28731592873aa6a263cb0a2056d791e6 not found: ID does not exist" containerID="788863a324d1a05ddb121530a50c6a7c28731592873aa6a263cb0a2056d791e6" Jul 09 16:16:33.550670 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:33.550627 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"788863a324d1a05ddb121530a50c6a7c28731592873aa6a263cb0a2056d791e6"} err="failed to get container status \"788863a324d1a05ddb121530a50c6a7c28731592873aa6a263cb0a2056d791e6\": rpc error: code = NotFound desc = could not find container \"788863a324d1a05ddb121530a50c6a7c28731592873aa6a263cb0a2056d791e6\": container with ID starting with 788863a324d1a05ddb121530a50c6a7c28731592873aa6a263cb0a2056d791e6 not found: ID does not exist" Jul 09 16:16:43.544599 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:43.544570 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:56.102424 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.102393 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw"] Jul 09 16:16:56.102843 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.102623 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" podUID="1885b5c7-3dcf-42cf-80d3-5e07470e1ea6" containerName="manager" containerID="cri-o://0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde" gracePeriod=10 Jul 09 16:16:56.358767 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.358705 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:56.520750 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.520710 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5px6x\" (UniqueName: \"kubernetes.io/projected/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-kube-api-access-5px6x\") pod \"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6\" (UID: \"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6\") " Jul 09 16:16:56.520750 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.520757 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-extensions-socket-volume\") pod \"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6\" (UID: \"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6\") " Jul 09 16:16:56.521194 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.521160 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1885b5c7-3dcf-42cf-80d3-5e07470e1ea6" (UID: "1885b5c7-3dcf-42cf-80d3-5e07470e1ea6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:16:56.522948 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.522928 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-kube-api-access-5px6x" (OuterVolumeSpecName: "kube-api-access-5px6x") pod "1885b5c7-3dcf-42cf-80d3-5e07470e1ea6" (UID: "1885b5c7-3dcf-42cf-80d3-5e07470e1ea6"). InnerVolumeSpecName "kube-api-access-5px6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:16:56.622274 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.622246 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5px6x\" (UniqueName: \"kubernetes.io/projected/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-kube-api-access-5px6x\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:16:56.622274 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.622275 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6-extensions-socket-volume\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:16:56.647632 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.647596 2581 generic.go:356] "Generic (PLEG): container finished" podID="1885b5c7-3dcf-42cf-80d3-5e07470e1ea6" containerID="0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde" exitCode=0 Jul 09 16:16:56.647793 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.647651 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" Jul 09 16:16:56.647793 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.647659 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" event={"ID":"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6","Type":"ContainerDied","Data":"0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde"} Jul 09 16:16:56.647793 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.647705 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw" event={"ID":"1885b5c7-3dcf-42cf-80d3-5e07470e1ea6","Type":"ContainerDied","Data":"ad15cd0bdfc20b6a007313305b5ac446e798a528bbc7d31748a44b38e5dfdded"} Jul 09 16:16:56.647793 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.647729 2581 scope.go:117] "RemoveContainer" containerID="0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde" Jul 09 16:16:56.656631 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.656615 2581 scope.go:117] "RemoveContainer" containerID="0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde" Jul 09 16:16:56.656861 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:16:56.656841 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde\": container with ID starting with 0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde not found: ID does not exist" containerID="0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde" Jul 09 16:16:56.656919 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.656867 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde"} err="failed to get container status \"0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde\": rpc error: code = NotFound desc = could not find container \"0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde\": container with ID starting with 0d53478fea66e82038e6a32f7c39e557ea88e8b2b19e2f6d58533dc54e4e8cde not found: ID does not exist" Jul 09 16:16:56.668635 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.668614 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw"] Jul 09 16:16:56.674423 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:56.674402 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8pqsw"] Jul 09 16:16:57.510531 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:16:57.510488 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1885b5c7-3dcf-42cf-80d3-5e07470e1ea6" path="/var/lib/kubelet/pods/1885b5c7-3dcf-42cf-80d3-5e07470e1ea6/volumes" Jul 09 16:17:04.845769 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.845688 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:17:04.846222 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.846186 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" containerName="manager" Jul 09 16:17:04.846222 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.846203 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" containerName="manager" Jul 09 16:17:04.846333 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.846250 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1885b5c7-3dcf-42cf-80d3-5e07470e1ea6" containerName="manager" Jul 09 16:17:04.846333 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.846259 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1885b5c7-3dcf-42cf-80d3-5e07470e1ea6" containerName="manager" Jul 09 16:17:04.846433 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.846361 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="806d4c06-b1a4-4fcc-9e94-b0e773b59f6a" containerName="manager" Jul 09 16:17:04.846433 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.846376 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1885b5c7-3dcf-42cf-80d3-5e07470e1ea6" containerName="manager" Jul 09 16:17:04.848972 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.848953 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" Jul 09 16:17:04.851444 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.851420 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 16:17:04.857209 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.857185 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:17:04.883805 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.883780 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:17:04.888737 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.888718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9b90bb88-42a9-4928-9d18-d67a8d3bc7e5-config-file\") pod \"limitador-limitador-54d6d988d5-pmlgx\" (UID: \"9b90bb88-42a9-4928-9d18-d67a8d3bc7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" Jul 09 16:17:04.888795 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.888753 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptlfx\" (UniqueName: \"kubernetes.io/projected/9b90bb88-42a9-4928-9d18-d67a8d3bc7e5-kube-api-access-ptlfx\") pod \"limitador-limitador-54d6d988d5-pmlgx\" (UID: \"9b90bb88-42a9-4928-9d18-d67a8d3bc7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" Jul 09 16:17:04.989538 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.989503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9b90bb88-42a9-4928-9d18-d67a8d3bc7e5-config-file\") pod \"limitador-limitador-54d6d988d5-pmlgx\" (UID: \"9b90bb88-42a9-4928-9d18-d67a8d3bc7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" Jul 09 16:17:04.989538 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.989543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptlfx\" (UniqueName: \"kubernetes.io/projected/9b90bb88-42a9-4928-9d18-d67a8d3bc7e5-kube-api-access-ptlfx\") pod \"limitador-limitador-54d6d988d5-pmlgx\" (UID: \"9b90bb88-42a9-4928-9d18-d67a8d3bc7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" Jul 09 16:17:04.990149 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.990131 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9b90bb88-42a9-4928-9d18-d67a8d3bc7e5-config-file\") pod \"limitador-limitador-54d6d988d5-pmlgx\" (UID: \"9b90bb88-42a9-4928-9d18-d67a8d3bc7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" Jul 09 16:17:04.998284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:04.998262 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptlfx\" (UniqueName: \"kubernetes.io/projected/9b90bb88-42a9-4928-9d18-d67a8d3bc7e5-kube-api-access-ptlfx\") pod \"limitador-limitador-54d6d988d5-pmlgx\" (UID: \"9b90bb88-42a9-4928-9d18-d67a8d3bc7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" Jul 09 16:17:05.159919 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:05.159890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" Jul 09 16:17:05.289449 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:05.289424 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:17:05.291424 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:17:05.291395 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b90bb88_42a9_4928_9d18_d67a8d3bc7e5.slice/crio-dfb39e0568144468a684c9dfbc05334ccc1b1384981a7771fc37092b03433bb0 WatchSource:0}: Error finding container dfb39e0568144468a684c9dfbc05334ccc1b1384981a7771fc37092b03433bb0: Status 404 returned error can't find the container with id dfb39e0568144468a684c9dfbc05334ccc1b1384981a7771fc37092b03433bb0 Jul 09 16:17:05.688308 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:05.688277 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" event={"ID":"9b90bb88-42a9-4928-9d18-d67a8d3bc7e5","Type":"ContainerStarted","Data":"dfb39e0568144468a684c9dfbc05334ccc1b1384981a7771fc37092b03433bb0"} Jul 09 16:17:08.708188 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:08.708155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" event={"ID":"9b90bb88-42a9-4928-9d18-d67a8d3bc7e5","Type":"ContainerStarted","Data":"22959e5079984485648c54aae0538d0a85c0c9547fd26363560dedc4f7ccd57e"} Jul 09 16:17:08.708698 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:08.708282 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" Jul 09 16:17:08.724560 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:08.724504 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" podStartSLOduration=1.519776566 podStartE2EDuration="4.724458217s" totalImagesPullingTime="3.204681651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:17:08.723855282 +0000 UTC m=+805.795451256" watchObservedRunningTime="2026-07-09 16:17:08.724458217 +0000 UTC m=+805.796054167" Jul 09 16:17:19.714000 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:17:19.713974 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pmlgx" Jul 09 16:18:18.626968 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.626934 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-5n99c"] Jul 09 16:18:18.630334 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.630315 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" Jul 09 16:18:18.633097 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.633077 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 09 16:18:18.640631 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.640607 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-5n99c"] Jul 09 16:18:18.716684 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.716652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/564c8ee4-bee6-462d-9a41-d10971cd9663-plugins-config-volume\") pod \"payload-pre-processing-7964457696-5n99c\" (UID: \"564c8ee4-bee6-462d-9a41-d10971cd9663\") " pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" Jul 09 16:18:18.716846 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.716711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kvbb\" (UniqueName: \"kubernetes.io/projected/564c8ee4-bee6-462d-9a41-d10971cd9663-kube-api-access-9kvbb\") pod \"payload-pre-processing-7964457696-5n99c\" (UID: \"564c8ee4-bee6-462d-9a41-d10971cd9663\") " pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" Jul 09 16:18:18.722389 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.722367 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:18:18.817222 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.817196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/564c8ee4-bee6-462d-9a41-d10971cd9663-plugins-config-volume\") pod \"payload-pre-processing-7964457696-5n99c\" (UID: \"564c8ee4-bee6-462d-9a41-d10971cd9663\") " pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" Jul 09 16:18:18.817384 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.817244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kvbb\" (UniqueName: \"kubernetes.io/projected/564c8ee4-bee6-462d-9a41-d10971cd9663-kube-api-access-9kvbb\") pod \"payload-pre-processing-7964457696-5n99c\" (UID: \"564c8ee4-bee6-462d-9a41-d10971cd9663\") " pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" Jul 09 16:18:18.817996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.817969 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/564c8ee4-bee6-462d-9a41-d10971cd9663-plugins-config-volume\") pod \"payload-pre-processing-7964457696-5n99c\" (UID: \"564c8ee4-bee6-462d-9a41-d10971cd9663\") " pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" Jul 09 16:18:18.829005 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.828985 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kvbb\" (UniqueName: \"kubernetes.io/projected/564c8ee4-bee6-462d-9a41-d10971cd9663-kube-api-access-9kvbb\") pod \"payload-pre-processing-7964457696-5n99c\" (UID: \"564c8ee4-bee6-462d-9a41-d10971cd9663\") " pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" Jul 09 16:18:18.941960 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:18.941884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" Jul 09 16:18:19.076900 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:19.076870 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-5n99c"] Jul 09 16:18:19.079017 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:18:19.078986 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564c8ee4_bee6_462d_9a41_d10971cd9663.slice/crio-58d678898c2ec1854c93b790c4d099491503a755b423bfebdcd37752b7a95ea7 WatchSource:0}: Error finding container 58d678898c2ec1854c93b790c4d099491503a755b423bfebdcd37752b7a95ea7: Status 404 returned error can't find the container with id 58d678898c2ec1854c93b790c4d099491503a755b423bfebdcd37752b7a95ea7 Jul 09 16:18:20.036895 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:20.036860 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" event={"ID":"564c8ee4-bee6-462d-9a41-d10971cd9663","Type":"ContainerStarted","Data":"58d678898c2ec1854c93b790c4d099491503a755b423bfebdcd37752b7a95ea7"} Jul 09 16:18:22.048717 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:22.048683 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" event={"ID":"564c8ee4-bee6-462d-9a41-d10971cd9663","Type":"ContainerStarted","Data":"cddbb3349f8b423ba847ffb239ebb12a52b2a998d54db7f32322e0bc2f17effd"} Jul 09 16:18:22.049227 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:22.048833 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" Jul 09 16:18:22.065062 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:22.065009 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" podStartSLOduration=1.724332209 podStartE2EDuration="4.064992899s" totalImagesPullingTime="2.34066069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:18:22.063492871 +0000 UTC m=+879.135088834" watchObservedRunningTime="2026-07-09 16:18:22.064992899 +0000 UTC m=+879.136588845" Jul 09 16:18:33.055811 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:33.055779 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-5n99c" Jul 09 16:18:38.366228 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:38.366190 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:18:43.437600 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:43.437574 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:18:43.440001 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:43.439977 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:18:44.659926 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.659892 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62"] Jul 09 16:18:44.662833 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.662817 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.665594 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.665570 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 16:18:44.665737 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.665574 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2w89m\"" Jul 09 16:18:44.665737 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.665631 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 09 16:18:44.665737 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.665715 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 16:18:44.672159 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.672141 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62"] Jul 09 16:18:44.750625 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.750583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.750625 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.750623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.750831 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.750692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.750831 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.750714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.750831 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.750763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.750831 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.750778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsd24\" (UniqueName: \"kubernetes.io/projected/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-kube-api-access-bsd24\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.851916 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.851880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.851916 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.851924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsd24\" (UniqueName: \"kubernetes.io/projected/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-kube-api-access-bsd24\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.852191 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.852063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.852191 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.852098 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.852191 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.852180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.852347 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.852221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.852347 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.852299 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.852598 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.852578 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.852679 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.852601 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.854537 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.854512 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.854750 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.854733 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.859699 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.859681 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsd24\" (UniqueName: \"kubernetes.io/projected/6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d-kube-api-access-bsd24\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b4s62\" (UID: \"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:44.976214 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:44.976119 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:45.114064 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:45.114040 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62"] Jul 09 16:18:45.116314 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:18:45.116282 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0de3c9_3e8d_4fda_abb0_11d40de8ba9d.slice/crio-195e73c6fe7e3d4b6fa0944e4531683db4a0eea141d3d5f24906e4a5a524da8d WatchSource:0}: Error finding container 195e73c6fe7e3d4b6fa0944e4531683db4a0eea141d3d5f24906e4a5a524da8d: Status 404 returned error can't find the container with id 195e73c6fe7e3d4b6fa0944e4531683db4a0eea141d3d5f24906e4a5a524da8d Jul 09 16:18:45.155054 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:45.155018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" event={"ID":"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d","Type":"ContainerStarted","Data":"195e73c6fe7e3d4b6fa0944e4531683db4a0eea141d3d5f24906e4a5a524da8d"} Jul 09 16:18:45.667554 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:45.666939 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:18:47.166422 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:47.166386 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" event={"ID":"6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d","Type":"ContainerStarted","Data":"dbe16e5c1095b16efb999d6b32e9801fdb7ece968f5099f5b87b358ae2f51195"} Jul 09 16:18:47.185961 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:47.185902 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" podStartSLOduration=2.104089988 podStartE2EDuration="3.185880602s" totalImagesPullingTime="1.081790614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:18:47.185828836 +0000 UTC m=+904.257424788" watchObservedRunningTime="2026-07-09 16:18:47.185880602 +0000 UTC m=+904.257476553" Jul 09 16:18:52.867868 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:52.867832 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:18:54.977018 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:54.976984 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:54.977422 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:54.977036 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:54.989583 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:54.989560 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:18:55.215828 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:18:55.215798 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b4s62" Jul 09 16:19:03.566232 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.566194 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk"] Jul 09 16:19:03.572522 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.572459 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.575200 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.575176 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 09 16:19:03.579594 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.579564 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk"] Jul 09 16:19:03.612907 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.612875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.613087 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.612911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.613087 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.612968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.613087 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.612999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.613087 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.613056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6835d8d-19e2-4a48-9174-5cdd1a39a736-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.613231 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.613109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn9q2\" (UniqueName: \"kubernetes.io/projected/f6835d8d-19e2-4a48-9174-5cdd1a39a736-kube-api-access-rn9q2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.713958 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.713923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.713958 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.713958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.714203 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.714000 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.714203 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.714021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.714203 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.714048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6835d8d-19e2-4a48-9174-5cdd1a39a736-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.714203 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.714066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn9q2\" (UniqueName: \"kubernetes.io/projected/f6835d8d-19e2-4a48-9174-5cdd1a39a736-kube-api-access-rn9q2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.714390 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.714370 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.714445 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.714386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.714532 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.714511 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.716434 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.716408 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6835d8d-19e2-4a48-9174-5cdd1a39a736-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.716660 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.716641 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6835d8d-19e2-4a48-9174-5cdd1a39a736-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.722261 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.722232 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn9q2\" (UniqueName: \"kubernetes.io/projected/f6835d8d-19e2-4a48-9174-5cdd1a39a736-kube-api-access-rn9q2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk\" (UID: \"f6835d8d-19e2-4a48-9174-5cdd1a39a736\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:03.884703 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:03.884654 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:04.021206 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:04.021182 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk"] Jul 09 16:19:04.023147 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:19:04.023114 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6835d8d_19e2_4a48_9174_5cdd1a39a736.slice/crio-f916968f50d07d1ee7a51eda2074f0c6f4ab3662ad89987f045f49a67159894b WatchSource:0}: Error finding container f916968f50d07d1ee7a51eda2074f0c6f4ab3662ad89987f045f49a67159894b: Status 404 returned error can't find the container with id f916968f50d07d1ee7a51eda2074f0c6f4ab3662ad89987f045f49a67159894b Jul 09 16:19:04.246919 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:04.246891 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" event={"ID":"f6835d8d-19e2-4a48-9174-5cdd1a39a736","Type":"ContainerStarted","Data":"f916968f50d07d1ee7a51eda2074f0c6f4ab3662ad89987f045f49a67159894b"} Jul 09 16:19:05.253627 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:05.253592 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" event={"ID":"f6835d8d-19e2-4a48-9174-5cdd1a39a736","Type":"ContainerStarted","Data":"f0603559246144266fc9bbbc18cc08d5c72810d0a42d3421ff33aa4fe5a0cee9"} Jul 09 16:19:05.273918 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:05.273869 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" podStartSLOduration=2.064210016 podStartE2EDuration="2.273853139s" totalImagesPullingTime="209.643123ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:19:05.271993819 +0000 UTC m=+922.343589769" watchObservedRunningTime="2026-07-09 16:19:05.273853139 +0000 UTC m=+922.345449130" Jul 09 16:19:05.358242 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:05.358205 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:19:13.885577 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:13.885541 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:13.886045 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:13.885595 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:13.898153 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:13.898128 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:14.308978 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:14.308894 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk" Jul 09 16:19:15.657753 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:15.657717 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:19:31.565154 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:19:31.565119 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:21:00.866590 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:21:00.866551 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:21:10.952717 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:21:10.952681 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:21:21.961344 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:21:21.961313 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:21:30.666576 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:21:30.666539 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:21:41.099294 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:21:41.099213 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:22:08.573675 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:22:08.573647 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:22:20.857236 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:22:20.857193 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:23:00.769840 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:23:00.769798 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:23:11.177611 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:23:11.177532 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:23:20.362760 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:23:20.362727 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:23:32.370333 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:23:32.370300 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:23:43.466363 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:23:43.466334 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:23:43.471763 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:23:43.471744 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:23:43.562259 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:23:43.562224 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:23:53.574868 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:23:53.574834 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:24:04.275725 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:24:04.275685 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:24:14.677094 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:24:14.677057 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:24:35.760943 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:24:35.760838 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:24:48.065933 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:24:48.065895 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:25:11.561657 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:25:11.561620 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:25:22.769779 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:25:22.769742 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:25:37.164435 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:25:37.164401 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:25:49.065488 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:25:49.065413 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:26:03.464595 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:26:03.464557 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:28:03.165164 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:28:03.165065 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:28:12.557095 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:28:12.557061 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:28:26.266613 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:28:26.266576 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:28:35.785422 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:28:35.785382 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:28:43.499943 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:28:43.499916 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:28:43.504145 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:28:43.504124 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:28:45.261487 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:28:45.261434 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:28:54.061770 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:28:54.061733 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:29:05.165312 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:29:05.165234 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:29:16.264019 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:29:16.263985 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:29:25.271487 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:29:25.271431 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:29:36.661863 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:29:36.661827 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:29:47.158814 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:29:47.158780 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:29:53.765320 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:29:53.765284 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:30:14.979254 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:30:14.979221 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:30:24.967309 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:30:24.967276 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:30:35.654908 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:30:35.654826 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:30:45.465602 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:30:45.465563 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:30:54.362277 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:30:54.362242 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:31:04.272153 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:31:04.272119 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:31:18.265011 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:31:18.264977 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:31:27.469521 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:31:27.469480 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:31:35.777527 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:31:35.777494 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:31:45.764573 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:31:45.764534 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:31:55.767561 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:31:55.767524 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:32:09.267549 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:32:09.267447 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:32:19.372740 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:32:19.372705 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:32:34.261136 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:32:34.261100 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:32:42.113237 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:32:42.113206 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:32:52.365276 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:32:52.365242 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:33:09.765271 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:33:09.765233 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:33:22.264816 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:33:22.264782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:33:33.965644 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:33:33.965610 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:33:43.531170 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:33:43.531135 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:33:43.535868 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:33:43.535846 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:33:46.162402 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:33:46.162361 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:33:55.060078 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:33:55.060046 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:34:05.360682 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:34:05.360645 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:34:22.557110 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:34:22.557081 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:34:34.275710 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:34:34.275678 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:34:41.959482 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:34:41.959430 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:34:52.169902 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:34:52.169866 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:36:10.858068 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:36:10.858027 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:36:20.365046 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:36:20.365006 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:36:31.663779 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:36:31.663745 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:36:42.379322 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:36:42.379231 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:37:08.957865 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:37:08.957824 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:37:23.558706 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:37:23.558673 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:37:36.167278 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:37:36.167242 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:37:46.260626 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:37:46.260584 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:37:58.559606 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:37:58.559572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:38:30.162205 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:38:30.162173 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:38:43.561050 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:38:43.561023 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:38:43.567071 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:38:43.567046 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:38:51.063670 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:38:51.063634 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:39:03.662560 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:39:03.662527 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:39:53.182996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:39:53.182914 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:40:07.365461 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:40:07.365426 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:40:19.367559 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:40:19.367529 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:40:38.179173 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:40:38.179136 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:41:00.860898 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:41:00.860858 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:41:43.258673 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:41:43.258642 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:41:57.861539 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:41:57.861502 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:42:13.156276 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:42:13.156219 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:42:25.464980 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:42:25.464946 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:42:34.762336 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:42:34.762250 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:42:50.559585 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:42:50.559549 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:43:00.157079 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:43:00.157044 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:43:20.558682 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:43:20.558647 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:43:32.770853 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:43:32.770813 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:43:43.589602 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:43:43.589574 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:43:43.597362 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:43:43.597341 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:43:54.468547 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:43:54.468516 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:44:14.056785 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:44:14.056694 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:44:32.963752 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:44:32.963716 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:44:49.164944 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:44:49.164912 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:45:00.133538 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.133506 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r"] Jul 09 16:45:00.137191 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.137156 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9"] Jul 09 16:45:00.137388 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.137271 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" Jul 09 16:45:00.140309 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.140286 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 16:45:00.141005 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.140984 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74"] Jul 09 16:45:00.141131 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.141114 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" Jul 09 16:45:00.141712 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.141694 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w7wwk\"" Jul 09 16:45:00.141809 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.141738 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 16:45:00.144127 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.144111 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" Jul 09 16:45:00.153114 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.153090 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9"] Jul 09 16:45:00.155076 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.155051 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r"] Jul 09 16:45:00.156986 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.156966 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74"] Jul 09 16:45:00.211889 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.211855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwhvb\" (UniqueName: \"kubernetes.io/projected/64a77afe-0c78-4317-a12e-7311c2b6da24-kube-api-access-xwhvb\") pod \"maas-api-key-cleanup-29726925-d84x9\" (UID: \"64a77afe-0c78-4317-a12e-7311c2b6da24\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" Jul 09 16:45:00.212076 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.211903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4xqk\" (UniqueName: \"kubernetes.io/projected/f1201ea4-d5ab-471d-b311-a6d91a62464b-kube-api-access-c4xqk\") pod \"maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74\" (UID: \"f1201ea4-d5ab-471d-b311-a6d91a62464b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" Jul 09 16:45:00.212076 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.211979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zppv9\" (UniqueName: \"kubernetes.io/projected/59fc7569-b8a0-4b48-86cc-cc7e8815ba45-kube-api-access-zppv9\") pod \"maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r\" (UID: \"59fc7569-b8a0-4b48-86cc-cc7e8815ba45\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" Jul 09 16:45:00.313326 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.313282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4xqk\" (UniqueName: \"kubernetes.io/projected/f1201ea4-d5ab-471d-b311-a6d91a62464b-kube-api-access-c4xqk\") pod \"maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74\" (UID: \"f1201ea4-d5ab-471d-b311-a6d91a62464b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" Jul 09 16:45:00.313569 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.313383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zppv9\" (UniqueName: \"kubernetes.io/projected/59fc7569-b8a0-4b48-86cc-cc7e8815ba45-kube-api-access-zppv9\") pod \"maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r\" (UID: \"59fc7569-b8a0-4b48-86cc-cc7e8815ba45\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" Jul 09 16:45:00.313569 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.313522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwhvb\" (UniqueName: \"kubernetes.io/projected/64a77afe-0c78-4317-a12e-7311c2b6da24-kube-api-access-xwhvb\") pod \"maas-api-key-cleanup-29726925-d84x9\" (UID: \"64a77afe-0c78-4317-a12e-7311c2b6da24\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" Jul 09 16:45:00.322327 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.322300 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4xqk\" (UniqueName: \"kubernetes.io/projected/f1201ea4-d5ab-471d-b311-a6d91a62464b-kube-api-access-c4xqk\") pod \"maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74\" (UID: \"f1201ea4-d5ab-471d-b311-a6d91a62464b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" Jul 09 16:45:00.322591 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.322571 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwhvb\" (UniqueName: \"kubernetes.io/projected/64a77afe-0c78-4317-a12e-7311c2b6da24-kube-api-access-xwhvb\") pod \"maas-api-key-cleanup-29726925-d84x9\" (UID: \"64a77afe-0c78-4317-a12e-7311c2b6da24\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" Jul 09 16:45:00.322640 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.322568 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zppv9\" (UniqueName: \"kubernetes.io/projected/59fc7569-b8a0-4b48-86cc-cc7e8815ba45-kube-api-access-zppv9\") pod \"maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r\" (UID: \"59fc7569-b8a0-4b48-86cc-cc7e8815ba45\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" Jul 09 16:45:00.449412 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.449328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" Jul 09 16:45:00.459531 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.459509 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" Jul 09 16:45:00.466403 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.466381 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" Jul 09 16:45:00.612273 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.612241 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r"] Jul 09 16:45:00.617847 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:45:00.616497 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fc7569_b8a0_4b48_86cc_cc7e8815ba45.slice/crio-585fd10c921eff05d7d95457f0ea4398539e1a3395795bbb1cf408652f0825a6 WatchSource:0}: Error finding container 585fd10c921eff05d7d95457f0ea4398539e1a3395795bbb1cf408652f0825a6: Status 404 returned error can't find the container with id 585fd10c921eff05d7d95457f0ea4398539e1a3395795bbb1cf408652f0825a6 Jul 09 16:45:00.619867 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.619848 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:45:00.844229 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.844200 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74"] Jul 09 16:45:00.846843 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:45:00.846821 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1201ea4_d5ab_471d_b311_a6d91a62464b.slice/crio-7497dc3ac91be4924674cc5ba4ef7e37b694142e6d2a4025d733e61357f70afb WatchSource:0}: Error finding container 7497dc3ac91be4924674cc5ba4ef7e37b694142e6d2a4025d733e61357f70afb: Status 404 returned error can't find the container with id 7497dc3ac91be4924674cc5ba4ef7e37b694142e6d2a4025d733e61357f70afb Jul 09 16:45:00.847324 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:00.847300 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9"] Jul 09 16:45:00.849383 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:45:00.849357 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a77afe_0c78_4317_a12e_7311c2b6da24.slice/crio-4db3d25a9b8e0d4787c13be0a5b2c4dd77ee9c94296ccea4f2ef45fa0d76d21b WatchSource:0}: Error finding container 4db3d25a9b8e0d4787c13be0a5b2c4dd77ee9c94296ccea4f2ef45fa0d76d21b: Status 404 returned error can't find the container with id 4db3d25a9b8e0d4787c13be0a5b2c4dd77ee9c94296ccea4f2ef45fa0d76d21b Jul 09 16:45:01.557603 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:01.557571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" event={"ID":"59fc7569-b8a0-4b48-86cc-cc7e8815ba45","Type":"ContainerStarted","Data":"585fd10c921eff05d7d95457f0ea4398539e1a3395795bbb1cf408652f0825a6"} Jul 09 16:45:01.558705 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:01.558678 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" event={"ID":"f1201ea4-d5ab-471d-b311-a6d91a62464b","Type":"ContainerStarted","Data":"7497dc3ac91be4924674cc5ba4ef7e37b694142e6d2a4025d733e61357f70afb"} Jul 09 16:45:01.559935 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:01.559913 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" event={"ID":"64a77afe-0c78-4317-a12e-7311c2b6da24","Type":"ContainerStarted","Data":"4db3d25a9b8e0d4787c13be0a5b2c4dd77ee9c94296ccea4f2ef45fa0d76d21b"} Jul 09 16:45:04.576698 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:04.576664 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" event={"ID":"59fc7569-b8a0-4b48-86cc-cc7e8815ba45","Type":"ContainerStarted","Data":"0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da"} Jul 09 16:45:04.578232 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:04.578201 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" event={"ID":"f1201ea4-d5ab-471d-b311-a6d91a62464b","Type":"ContainerStarted","Data":"dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f"} Jul 09 16:45:04.579782 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:04.579713 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" event={"ID":"64a77afe-0c78-4317-a12e-7311c2b6da24","Type":"ContainerStarted","Data":"febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725"} Jul 09 16:45:04.590837 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:04.590790 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" podStartSLOduration=1.95253888 podStartE2EDuration="4.590776544s" totalImagesPullingTime="2.638237664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:45:04.590243185 +0000 UTC m=+2481.661839139" watchObservedRunningTime="2026-07-09 16:45:04.590776544 +0000 UTC m=+2481.662372493" Jul 09 16:45:04.605356 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:04.605313 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" podStartSLOduration=2.190893677 podStartE2EDuration="4.605299189s" totalImagesPullingTime="2.414405512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:45:04.604209985 +0000 UTC m=+2481.675805935" watchObservedRunningTime="2026-07-09 16:45:04.605299189 +0000 UTC m=+2481.676895188" Jul 09 16:45:04.619772 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:04.619730 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" podStartSLOduration=2.052846838 podStartE2EDuration="4.619716166s" totalImagesPullingTime="2.566869328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:45:04.618264306 +0000 UTC m=+2481.689860295" watchObservedRunningTime="2026-07-09 16:45:04.619716166 +0000 UTC m=+2481.691312116" Jul 09 16:45:07.066192 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:07.066155 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:45:24.865290 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:24.865254 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:45:44.257789 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:44.257712 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:45:57.173941 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:45:57.173906 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:46:00.011373 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:00.011339 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r"] Jul 09 16:46:00.011874 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:00.011612 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" podUID="59fc7569-b8a0-4b48-86cc-cc7e8815ba45" containerName="cleanup" containerID="cri-o://0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da" gracePeriod=30 Jul 09 16:46:00.013147 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:00.013122 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74"] Jul 09 16:46:00.013414 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:00.013364 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" podUID="f1201ea4-d5ab-471d-b311-a6d91a62464b" containerName="cleanup" containerID="cri-o://dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f" gracePeriod=30 Jul 09 16:46:00.014540 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:00.014516 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9"] Jul 09 16:46:00.014710 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:00.014665 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" podUID="64a77afe-0c78-4317-a12e-7311c2b6da24" containerName="cleanup" containerID="cri-o://febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725" gracePeriod=30 Jul 09 16:46:12.072531 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:12.072495 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:46:30.224949 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.224916 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" Jul 09 16:46:30.254852 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.254828 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" Jul 09 16:46:30.258954 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.258934 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" Jul 09 16:46:30.276609 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.276545 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwhvb\" (UniqueName: \"kubernetes.io/projected/64a77afe-0c78-4317-a12e-7311c2b6da24-kube-api-access-xwhvb\") pod \"64a77afe-0c78-4317-a12e-7311c2b6da24\" (UID: \"64a77afe-0c78-4317-a12e-7311c2b6da24\") " Jul 09 16:46:30.276609 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.276581 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4xqk\" (UniqueName: \"kubernetes.io/projected/f1201ea4-d5ab-471d-b311-a6d91a62464b-kube-api-access-c4xqk\") pod \"f1201ea4-d5ab-471d-b311-a6d91a62464b\" (UID: \"f1201ea4-d5ab-471d-b311-a6d91a62464b\") " Jul 09 16:46:30.276805 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.276642 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zppv9\" (UniqueName: \"kubernetes.io/projected/59fc7569-b8a0-4b48-86cc-cc7e8815ba45-kube-api-access-zppv9\") pod \"59fc7569-b8a0-4b48-86cc-cc7e8815ba45\" (UID: \"59fc7569-b8a0-4b48-86cc-cc7e8815ba45\") " Jul 09 16:46:30.278886 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.278855 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1201ea4-d5ab-471d-b311-a6d91a62464b-kube-api-access-c4xqk" (OuterVolumeSpecName: "kube-api-access-c4xqk") pod "f1201ea4-d5ab-471d-b311-a6d91a62464b" (UID: "f1201ea4-d5ab-471d-b311-a6d91a62464b"). InnerVolumeSpecName "kube-api-access-c4xqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:46:30.278886 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.278876 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59fc7569-b8a0-4b48-86cc-cc7e8815ba45-kube-api-access-zppv9" (OuterVolumeSpecName: "kube-api-access-zppv9") pod "59fc7569-b8a0-4b48-86cc-cc7e8815ba45" (UID: "59fc7569-b8a0-4b48-86cc-cc7e8815ba45"). InnerVolumeSpecName "kube-api-access-zppv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:46:30.279020 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.278909 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a77afe-0c78-4317-a12e-7311c2b6da24-kube-api-access-xwhvb" (OuterVolumeSpecName: "kube-api-access-xwhvb") pod "64a77afe-0c78-4317-a12e-7311c2b6da24" (UID: "64a77afe-0c78-4317-a12e-7311c2b6da24"). InnerVolumeSpecName "kube-api-access-xwhvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:46:30.377776 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.377746 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zppv9\" (UniqueName: \"kubernetes.io/projected/59fc7569-b8a0-4b48-86cc-cc7e8815ba45-kube-api-access-zppv9\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:46:30.377776 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.377774 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwhvb\" (UniqueName: \"kubernetes.io/projected/64a77afe-0c78-4317-a12e-7311c2b6da24-kube-api-access-xwhvb\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:46:30.377776 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.377785 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4xqk\" (UniqueName: \"kubernetes.io/projected/f1201ea4-d5ab-471d-b311-a6d91a62464b-kube-api-access-c4xqk\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:46:30.988758 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.988715 2581 generic.go:356] "Generic (PLEG): container finished" podID="f1201ea4-d5ab-471d-b311-a6d91a62464b" containerID="dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f" exitCode=137 Jul 09 16:46:30.988758 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.988762 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" Jul 09 16:46:30.989031 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.988758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" event={"ID":"f1201ea4-d5ab-471d-b311-a6d91a62464b","Type":"ContainerDied","Data":"dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f"} Jul 09 16:46:30.989031 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.988890 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74" event={"ID":"f1201ea4-d5ab-471d-b311-a6d91a62464b","Type":"ContainerDied","Data":"7497dc3ac91be4924674cc5ba4ef7e37b694142e6d2a4025d733e61357f70afb"} Jul 09 16:46:30.989031 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.988934 2581 scope.go:117] "RemoveContainer" containerID="dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f" Jul 09 16:46:30.990199 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.990174 2581 generic.go:356] "Generic (PLEG): container finished" podID="64a77afe-0c78-4317-a12e-7311c2b6da24" containerID="febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725" exitCode=137 Jul 09 16:46:30.990300 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.990209 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" Jul 09 16:46:30.990300 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.990254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" event={"ID":"64a77afe-0c78-4317-a12e-7311c2b6da24","Type":"ContainerDied","Data":"febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725"} Jul 09 16:46:30.990603 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.990299 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9" event={"ID":"64a77afe-0c78-4317-a12e-7311c2b6da24","Type":"ContainerDied","Data":"4db3d25a9b8e0d4787c13be0a5b2c4dd77ee9c94296ccea4f2ef45fa0d76d21b"} Jul 09 16:46:30.991876 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.991845 2581 generic.go:356] "Generic (PLEG): container finished" podID="59fc7569-b8a0-4b48-86cc-cc7e8815ba45" containerID="0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da" exitCode=137 Jul 09 16:46:30.992023 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.991877 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" event={"ID":"59fc7569-b8a0-4b48-86cc-cc7e8815ba45","Type":"ContainerDied","Data":"0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da"} Jul 09 16:46:30.992023 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.991888 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" Jul 09 16:46:30.992023 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:30.991924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r" event={"ID":"59fc7569-b8a0-4b48-86cc-cc7e8815ba45","Type":"ContainerDied","Data":"585fd10c921eff05d7d95457f0ea4398539e1a3395795bbb1cf408652f0825a6"} Jul 09 16:46:31.000028 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.000004 2581 scope.go:117] "RemoveContainer" containerID="dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f" Jul 09 16:46:31.000357 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:46:31.000333 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f\": container with ID starting with dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f not found: ID does not exist" containerID="dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f" Jul 09 16:46:31.000442 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.000373 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f"} err="failed to get container status \"dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f\": rpc error: code = NotFound desc = could not find container \"dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f\": container with ID starting with dde49f48dbbcbbd3a37956006166d6f4ab49cee62f116c2818dc50ee9979f54f not found: ID does not exist" Jul 09 16:46:31.000442 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.000396 2581 scope.go:117] "RemoveContainer" containerID="febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725" Jul 09 16:46:31.010799 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.010782 2581 scope.go:117] "RemoveContainer" containerID="febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725" Jul 09 16:46:31.011047 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:46:31.011027 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725\": container with ID starting with febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725 not found: ID does not exist" containerID="febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725" Jul 09 16:46:31.011095 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.011060 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725"} err="failed to get container status \"febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725\": rpc error: code = NotFound desc = could not find container \"febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725\": container with ID starting with febc9c075fb7c48cc2ca9860be539ee1ad4dec31a4f72f5d441551539af00725 not found: ID does not exist" Jul 09 16:46:31.011095 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.011081 2581 scope.go:117] "RemoveContainer" containerID="0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da" Jul 09 16:46:31.018496 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.018454 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9"] Jul 09 16:46:31.019035 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.018875 2581 scope.go:117] "RemoveContainer" containerID="0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da" Jul 09 16:46:31.019119 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:46:31.019101 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da\": container with ID starting with 0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da not found: ID does not exist" containerID="0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da" Jul 09 16:46:31.019157 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.019125 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da"} err="failed to get container status \"0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da\": rpc error: code = NotFound desc = could not find container \"0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da\": container with ID starting with 0c848d215b3aae75fc542297c125ff7bfd1209b37b7846634369b4e5083a44da not found: ID does not exist" Jul 09 16:46:31.022293 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.022273 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726925-d84x9"] Jul 09 16:46:31.032144 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.032124 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74"] Jul 09 16:46:31.035401 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.035382 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a36bf9-29726925-77q74"] Jul 09 16:46:31.045380 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.045356 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r"] Jul 09 16:46:31.047075 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.047056 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fb02fd-29726925-tbn6r"] Jul 09 16:46:31.511368 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.511336 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59fc7569-b8a0-4b48-86cc-cc7e8815ba45" path="/var/lib/kubelet/pods/59fc7569-b8a0-4b48-86cc-cc7e8815ba45/volumes" Jul 09 16:46:31.511769 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.511702 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a77afe-0c78-4317-a12e-7311c2b6da24" path="/var/lib/kubelet/pods/64a77afe-0c78-4317-a12e-7311c2b6da24/volumes" Jul 09 16:46:31.511976 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.511962 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1201ea4-d5ab-471d-b311-a6d91a62464b" path="/var/lib/kubelet/pods/f1201ea4-d5ab-471d-b311-a6d91a62464b/volumes" Jul 09 16:46:31.957847 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:31.957817 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:46:47.952168 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:46:47.952132 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:47:12.957233 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:12.957197 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:47:27.169245 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:27.169200 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:47:43.153662 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:43.153629 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:47:51.117117 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.117061 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7771-139965208677296"] Jul 09 16:47:51.117719 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.117628 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1201ea4-d5ab-471d-b311-a6d91a62464b" containerName="cleanup" Jul 09 16:47:51.117719 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.117646 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1201ea4-d5ab-471d-b311-a6d91a62464b" containerName="cleanup" Jul 09 16:47:51.117719 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.117663 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59fc7569-b8a0-4b48-86cc-cc7e8815ba45" containerName="cleanup" Jul 09 16:47:51.117719 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.117671 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="59fc7569-b8a0-4b48-86cc-cc7e8815ba45" containerName="cleanup" Jul 09 16:47:51.117719 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.117715 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a77afe-0c78-4317-a12e-7311c2b6da24" containerName="cleanup" Jul 09 16:47:51.117944 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.117725 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a77afe-0c78-4317-a12e-7311c2b6da24" containerName="cleanup" Jul 09 16:47:51.117944 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.117810 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1201ea4-d5ab-471d-b311-a6d91a62464b" containerName="cleanup" Jul 09 16:47:51.117944 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.117826 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="59fc7569-b8a0-4b48-86cc-cc7e8815ba45" containerName="cleanup" Jul 09 16:47:51.117944 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.117836 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a77afe-0c78-4317-a12e-7311c2b6da24" containerName="cleanup" Jul 09 16:47:51.120788 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.120767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965208677296" Jul 09 16:47:51.123853 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.123834 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-z4snt\"" Jul 09 16:47:51.127264 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.127241 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965208677296"] Jul 09 16:47:51.262232 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.262193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p8jr\" (UniqueName: \"kubernetes.io/projected/751cd69f-eecc-4f01-8700-cebc5688858f-kube-api-access-6p8jr\") pod \"test-curl-7771-139965208677296\" (UID: \"751cd69f-eecc-4f01-8700-cebc5688858f\") " pod="openshift-ingress/test-curl-7771-139965208677296" Jul 09 16:47:51.363680 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.363636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p8jr\" (UniqueName: \"kubernetes.io/projected/751cd69f-eecc-4f01-8700-cebc5688858f-kube-api-access-6p8jr\") pod \"test-curl-7771-139965208677296\" (UID: \"751cd69f-eecc-4f01-8700-cebc5688858f\") " pod="openshift-ingress/test-curl-7771-139965208677296" Jul 09 16:47:51.372703 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.372636 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p8jr\" (UniqueName: \"kubernetes.io/projected/751cd69f-eecc-4f01-8700-cebc5688858f-kube-api-access-6p8jr\") pod \"test-curl-7771-139965208677296\" (UID: \"751cd69f-eecc-4f01-8700-cebc5688858f\") " pod="openshift-ingress/test-curl-7771-139965208677296" Jul 09 16:47:51.430680 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.430646 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965208677296" Jul 09 16:47:51.565998 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:51.565907 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965208677296"] Jul 09 16:47:51.568831 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:47:51.568800 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod751cd69f_eecc_4f01_8700_cebc5688858f.slice/crio-7f177b2478d11029da5a4ece4f727f61fe4097b4025f439007cd1c5bd78f4c2f WatchSource:0}: Error finding container 7f177b2478d11029da5a4ece4f727f61fe4097b4025f439007cd1c5bd78f4c2f: Status 404 returned error can't find the container with id 7f177b2478d11029da5a4ece4f727f61fe4097b4025f439007cd1c5bd78f4c2f Jul 09 16:47:52.386263 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:52.386232 2581 generic.go:356] "Generic (PLEG): container finished" podID="751cd69f-eecc-4f01-8700-cebc5688858f" containerID="1791d29ced318ea64c4d5ffecbe1dffe2b5574b64941b546fc8d354a4a1687fb" exitCode=0 Jul 09 16:47:52.386622 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:52.386317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965208677296" event={"ID":"751cd69f-eecc-4f01-8700-cebc5688858f","Type":"ContainerDied","Data":"1791d29ced318ea64c4d5ffecbe1dffe2b5574b64941b546fc8d354a4a1687fb"} Jul 09 16:47:52.386622 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:52.386357 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965208677296" event={"ID":"751cd69f-eecc-4f01-8700-cebc5688858f","Type":"ContainerStarted","Data":"7f177b2478d11029da5a4ece4f727f61fe4097b4025f439007cd1c5bd78f4c2f"} Jul 09 16:47:53.530094 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.530065 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965208677296" Jul 09 16:47:53.566552 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.566493 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7771-139965208677296_751cd69f-eecc-4f01-8700-cebc5688858f/test-curl-7771-139965208677296/0.log" Jul 09 16:47:53.588962 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.588930 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7771-139965208677296"] Jul 09 16:47:53.592353 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.592329 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7771-139965208677296"] Jul 09 16:47:53.683834 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.683762 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p8jr\" (UniqueName: \"kubernetes.io/projected/751cd69f-eecc-4f01-8700-cebc5688858f-kube-api-access-6p8jr\") pod \"751cd69f-eecc-4f01-8700-cebc5688858f\" (UID: \"751cd69f-eecc-4f01-8700-cebc5688858f\") " Jul 09 16:47:53.685853 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.685823 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751cd69f-eecc-4f01-8700-cebc5688858f-kube-api-access-6p8jr" (OuterVolumeSpecName: "kube-api-access-6p8jr") pod "751cd69f-eecc-4f01-8700-cebc5688858f" (UID: "751cd69f-eecc-4f01-8700-cebc5688858f"). InnerVolumeSpecName "kube-api-access-6p8jr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:47:53.714656 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.714618 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7771-139965208675120"] Jul 09 16:47:53.715050 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.715034 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751cd69f-eecc-4f01-8700-cebc5688858f" containerName="test-curl-7771-139965208677296" Jul 09 16:47:53.715050 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.715051 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="751cd69f-eecc-4f01-8700-cebc5688858f" containerName="test-curl-7771-139965208677296" Jul 09 16:47:53.715231 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.715112 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="751cd69f-eecc-4f01-8700-cebc5688858f" containerName="test-curl-7771-139965208677296" Jul 09 16:47:53.717996 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.717980 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965208675120" Jul 09 16:47:53.724104 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.724074 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965208675120"] Jul 09 16:47:53.784853 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.784819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whqxt\" (UniqueName: \"kubernetes.io/projected/11a3db70-bdb0-4f59-9944-f1197c98c200-kube-api-access-whqxt\") pod \"test-curl-7771-139965208675120\" (UID: \"11a3db70-bdb0-4f59-9944-f1197c98c200\") " pod="openshift-ingress/test-curl-7771-139965208675120" Jul 09 16:47:53.785039 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.784973 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p8jr\" (UniqueName: \"kubernetes.io/projected/751cd69f-eecc-4f01-8700-cebc5688858f-kube-api-access-6p8jr\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:47:53.885377 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.885330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whqxt\" (UniqueName: \"kubernetes.io/projected/11a3db70-bdb0-4f59-9944-f1197c98c200-kube-api-access-whqxt\") pod \"test-curl-7771-139965208675120\" (UID: \"11a3db70-bdb0-4f59-9944-f1197c98c200\") " pod="openshift-ingress/test-curl-7771-139965208675120" Jul 09 16:47:53.894802 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:53.894763 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whqxt\" (UniqueName: \"kubernetes.io/projected/11a3db70-bdb0-4f59-9944-f1197c98c200-kube-api-access-whqxt\") pod \"test-curl-7771-139965208675120\" (UID: \"11a3db70-bdb0-4f59-9944-f1197c98c200\") " pod="openshift-ingress/test-curl-7771-139965208675120" Jul 09 16:47:54.027405 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:54.027316 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965208675120" Jul 09 16:47:54.160601 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:54.160579 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965208675120"] Jul 09 16:47:54.162214 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:47:54.162179 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11a3db70_bdb0_4f59_9944_f1197c98c200.slice/crio-ed18708e23817de86e9385992c8d39caacb99dae688f36f556bfdc26234388e4 WatchSource:0}: Error finding container ed18708e23817de86e9385992c8d39caacb99dae688f36f556bfdc26234388e4: Status 404 returned error can't find the container with id ed18708e23817de86e9385992c8d39caacb99dae688f36f556bfdc26234388e4 Jul 09 16:47:54.397890 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:54.397863 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965208677296" Jul 09 16:47:54.398078 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:54.397871 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f177b2478d11029da5a4ece4f727f61fe4097b4025f439007cd1c5bd78f4c2f" Jul 09 16:47:54.399209 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:54.399178 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965208675120" event={"ID":"11a3db70-bdb0-4f59-9944-f1197c98c200","Type":"ContainerStarted","Data":"ed18708e23817de86e9385992c8d39caacb99dae688f36f556bfdc26234388e4"} Jul 09 16:47:54.408342 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:47:54.408310 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-139965208677296\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="751cd69f-eecc-4f01-8700-cebc5688858f" pod="openshift-ingress/test-curl-7771-139965208677296" Jul 09 16:47:55.405175 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:55.405138 2581 generic.go:356] "Generic (PLEG): container finished" podID="11a3db70-bdb0-4f59-9944-f1197c98c200" containerID="558130fe84b516cc018b7d6b9c9e5bed2c269306ee6a9b56a0e56bab12921735" exitCode=0 Jul 09 16:47:55.405587 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:55.405237 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965208675120" event={"ID":"11a3db70-bdb0-4f59-9944-f1197c98c200","Type":"ContainerDied","Data":"558130fe84b516cc018b7d6b9c9e5bed2c269306ee6a9b56a0e56bab12921735"} Jul 09 16:47:55.407912 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:47:55.407888 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-139965208677296\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="751cd69f-eecc-4f01-8700-cebc5688858f" pod="openshift-ingress/test-curl-7771-139965208677296" Jul 09 16:47:55.511122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:55.511092 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="751cd69f-eecc-4f01-8700-cebc5688858f" path="/var/lib/kubelet/pods/751cd69f-eecc-4f01-8700-cebc5688858f/volumes" Jul 09 16:47:56.545434 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.545410 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965208675120" Jul 09 16:47:56.565898 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.565872 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7771-139965208675120_11a3db70-bdb0-4f59-9944-f1197c98c200/test-curl-7771-139965208675120/0.log" Jul 09 16:47:56.592326 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.592284 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7771-139965208675120"] Jul 09 16:47:56.595321 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.595298 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7771-139965208675120"] Jul 09 16:47:56.609291 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.609271 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whqxt\" (UniqueName: \"kubernetes.io/projected/11a3db70-bdb0-4f59-9944-f1197c98c200-kube-api-access-whqxt\") pod \"11a3db70-bdb0-4f59-9944-f1197c98c200\" (UID: \"11a3db70-bdb0-4f59-9944-f1197c98c200\") " Jul 09 16:47:56.611486 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.611435 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a3db70-bdb0-4f59-9944-f1197c98c200-kube-api-access-whqxt" (OuterVolumeSpecName: "kube-api-access-whqxt") pod "11a3db70-bdb0-4f59-9944-f1197c98c200" (UID: "11a3db70-bdb0-4f59-9944-f1197c98c200"). InnerVolumeSpecName "kube-api-access-whqxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:47:56.710671 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.710587 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whqxt\" (UniqueName: \"kubernetes.io/projected/11a3db70-bdb0-4f59-9944-f1197c98c200-kube-api-access-whqxt\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:47:56.742284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.742251 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7771-139965207975808"] Jul 09 16:47:56.742622 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.742609 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a3db70-bdb0-4f59-9944-f1197c98c200" containerName="test-curl-7771-139965208675120" Jul 09 16:47:56.742622 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.742623 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a3db70-bdb0-4f59-9944-f1197c98c200" containerName="test-curl-7771-139965208675120" Jul 09 16:47:56.742713 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.742695 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="11a3db70-bdb0-4f59-9944-f1197c98c200" containerName="test-curl-7771-139965208675120" Jul 09 16:47:56.745695 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.745680 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:47:56.749636 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.749612 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965207975808"] Jul 09 16:47:56.811073 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.811040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddr4l\" (UniqueName: \"kubernetes.io/projected/cd2ad95f-bc34-412a-988e-fa22badb8f02-kube-api-access-ddr4l\") pod \"test-curl-7771-139965207975808\" (UID: \"cd2ad95f-bc34-412a-988e-fa22badb8f02\") " pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:47:56.912295 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.912253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddr4l\" (UniqueName: \"kubernetes.io/projected/cd2ad95f-bc34-412a-988e-fa22badb8f02-kube-api-access-ddr4l\") pod \"test-curl-7771-139965207975808\" (UID: \"cd2ad95f-bc34-412a-988e-fa22badb8f02\") " pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:47:56.921141 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:56.921114 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddr4l\" (UniqueName: \"kubernetes.io/projected/cd2ad95f-bc34-412a-988e-fa22badb8f02-kube-api-access-ddr4l\") pod \"test-curl-7771-139965207975808\" (UID: \"cd2ad95f-bc34-412a-988e-fa22badb8f02\") " pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:47:57.055647 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:57.055543 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:47:57.187444 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:57.187417 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965207975808"] Jul 09 16:47:57.187671 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:47:57.187650 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd2ad95f_bc34_412a_988e_fa22badb8f02.slice/crio-d48006b74e9932177c9ecf9f9974c8673376b9710e1a64a359df22419a9a870d WatchSource:0}: Error finding container d48006b74e9932177c9ecf9f9974c8673376b9710e1a64a359df22419a9a870d: Status 404 returned error can't find the container with id d48006b74e9932177c9ecf9f9974c8673376b9710e1a64a359df22419a9a870d Jul 09 16:47:57.361241 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:57.361151 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:47:57.415210 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:57.415180 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965208675120" Jul 09 16:47:57.415380 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:57.415223 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed18708e23817de86e9385992c8d39caacb99dae688f36f556bfdc26234388e4" Jul 09 16:47:57.416374 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:57.416350 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965207975808" event={"ID":"cd2ad95f-bc34-412a-988e-fa22badb8f02","Type":"ContainerStarted","Data":"d48006b74e9932177c9ecf9f9974c8673376b9710e1a64a359df22419a9a870d"} Jul 09 16:47:57.425626 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:47:57.425602 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-139965208675120\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="11a3db70-bdb0-4f59-9944-f1197c98c200" pod="openshift-ingress/test-curl-7771-139965208675120" Jul 09 16:47:57.517615 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:57.517587 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11a3db70-bdb0-4f59-9944-f1197c98c200" path="/var/lib/kubelet/pods/11a3db70-bdb0-4f59-9944-f1197c98c200/volumes" Jul 09 16:47:58.422767 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:58.422731 2581 generic.go:356] "Generic (PLEG): container finished" podID="cd2ad95f-bc34-412a-988e-fa22badb8f02" containerID="c6d984d59aa9ce6a481b7b178f36620ca5d60f384e13b4db02353d8b824ff42e" exitCode=0 Jul 09 16:47:58.423252 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:58.422813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965207975808" event={"ID":"cd2ad95f-bc34-412a-988e-fa22badb8f02","Type":"ContainerDied","Data":"c6d984d59aa9ce6a481b7b178f36620ca5d60f384e13b4db02353d8b824ff42e"} Jul 09 16:47:59.564790 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.564765 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:47:59.586814 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.586781 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7771-139965207975808_cd2ad95f-bc34-412a-988e-fa22badb8f02/test-curl-7771-139965207975808/0.log" Jul 09 16:47:59.608060 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.608019 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7771-139965207975808"] Jul 09 16:47:59.611226 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.611200 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7771-139965207975808"] Jul 09 16:47:59.636837 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.636813 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddr4l\" (UniqueName: \"kubernetes.io/projected/cd2ad95f-bc34-412a-988e-fa22badb8f02-kube-api-access-ddr4l\") pod \"cd2ad95f-bc34-412a-988e-fa22badb8f02\" (UID: \"cd2ad95f-bc34-412a-988e-fa22badb8f02\") " Jul 09 16:47:59.638997 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.638965 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd2ad95f-bc34-412a-988e-fa22badb8f02-kube-api-access-ddr4l" (OuterVolumeSpecName: "kube-api-access-ddr4l") pod "cd2ad95f-bc34-412a-988e-fa22badb8f02" (UID: "cd2ad95f-bc34-412a-988e-fa22badb8f02"). InnerVolumeSpecName "kube-api-access-ddr4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:47:59.735528 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.735437 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7771-139965207975808"] Jul 09 16:47:59.735855 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.735842 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd2ad95f-bc34-412a-988e-fa22badb8f02" containerName="test-curl-7771-139965207975808" Jul 09 16:47:59.735904 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.735857 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd2ad95f-bc34-412a-988e-fa22badb8f02" containerName="test-curl-7771-139965207975808" Jul 09 16:47:59.735938 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.735917 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd2ad95f-bc34-412a-988e-fa22badb8f02" containerName="test-curl-7771-139965207975808" Jul 09 16:47:59.738121 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.738094 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddr4l\" (UniqueName: \"kubernetes.io/projected/cd2ad95f-bc34-412a-988e-fa22badb8f02-kube-api-access-ddr4l\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:47:59.738928 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.738913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:47:59.747554 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.747529 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965207975808"] Jul 09 16:47:59.839411 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.839377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmbtm\" (UniqueName: \"kubernetes.io/projected/164e3ee6-1460-4818-ad91-bf72c07f386b-kube-api-access-gmbtm\") pod \"test-curl-7771-139965207975808\" (UID: \"164e3ee6-1460-4818-ad91-bf72c07f386b\") " pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:47:59.939836 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.939795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmbtm\" (UniqueName: \"kubernetes.io/projected/164e3ee6-1460-4818-ad91-bf72c07f386b-kube-api-access-gmbtm\") pod \"test-curl-7771-139965207975808\" (UID: \"164e3ee6-1460-4818-ad91-bf72c07f386b\") " pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:47:59.949641 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:47:59.949611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmbtm\" (UniqueName: \"kubernetes.io/projected/164e3ee6-1460-4818-ad91-bf72c07f386b-kube-api-access-gmbtm\") pod \"test-curl-7771-139965207975808\" (UID: \"164e3ee6-1460-4818-ad91-bf72c07f386b\") " pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:48:00.048109 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:00.048038 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:48:00.178600 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:00.178575 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965207975808"] Jul 09 16:48:00.180838 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:48:00.180815 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod164e3ee6_1460_4818_ad91_bf72c07f386b.slice/crio-f7e97b49742f3fd2cc801dee72a001d1640c0d1fae1e075ff7b764be6ef99c2d WatchSource:0}: Error finding container f7e97b49742f3fd2cc801dee72a001d1640c0d1fae1e075ff7b764be6ef99c2d: Status 404 returned error can't find the container with id f7e97b49742f3fd2cc801dee72a001d1640c0d1fae1e075ff7b764be6ef99c2d Jul 09 16:48:00.433565 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:00.433533 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965207975808" event={"ID":"164e3ee6-1460-4818-ad91-bf72c07f386b","Type":"ContainerStarted","Data":"f7e97b49742f3fd2cc801dee72a001d1640c0d1fae1e075ff7b764be6ef99c2d"} Jul 09 16:48:00.434875 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:00.434855 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:48:00.434984 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:00.434854 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d48006b74e9932177c9ecf9f9974c8673376b9710e1a64a359df22419a9a870d" Jul 09 16:48:00.447603 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:00.447570 2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7771-139965207975808" oldPodUID="cd2ad95f-bc34-412a-988e-fa22badb8f02" podUID="164e3ee6-1460-4818-ad91-bf72c07f386b" Jul 09 16:48:01.441762 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:01.441722 2581 generic.go:356] "Generic (PLEG): container finished" podID="164e3ee6-1460-4818-ad91-bf72c07f386b" containerID="9e1193b46443a589de383aec1adf514cfad548af2feddf443225d65e18f2cb56" exitCode=0 Jul 09 16:48:01.441762 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:01.441764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965207975808" event={"ID":"164e3ee6-1460-4818-ad91-bf72c07f386b","Type":"ContainerDied","Data":"9e1193b46443a589de383aec1adf514cfad548af2feddf443225d65e18f2cb56"} Jul 09 16:48:01.511999 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:01.511967 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd2ad95f-bc34-412a-988e-fa22badb8f02" path="/var/lib/kubelet/pods/cd2ad95f-bc34-412a-988e-fa22badb8f02/volumes" Jul 09 16:48:02.589786 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.589755 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:48:02.609261 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.609238 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7771-139965207975808_164e3ee6-1460-4818-ad91-bf72c07f386b/test-curl-7771-139965207975808/0.log" Jul 09 16:48:02.632763 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.632727 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7771-139965207975808"] Jul 09 16:48:02.636059 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.636036 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7771-139965207975808"] Jul 09 16:48:02.765327 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.765196 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmbtm\" (UniqueName: \"kubernetes.io/projected/164e3ee6-1460-4818-ad91-bf72c07f386b-kube-api-access-gmbtm\") pod \"164e3ee6-1460-4818-ad91-bf72c07f386b\" (UID: \"164e3ee6-1460-4818-ad91-bf72c07f386b\") " Jul 09 16:48:02.767652 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.767615 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/164e3ee6-1460-4818-ad91-bf72c07f386b-kube-api-access-gmbtm" (OuterVolumeSpecName: "kube-api-access-gmbtm") pod "164e3ee6-1460-4818-ad91-bf72c07f386b" (UID: "164e3ee6-1460-4818-ad91-bf72c07f386b"). InnerVolumeSpecName "kube-api-access-gmbtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:48:02.767864 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.767843 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7771-139965207976816"] Jul 09 16:48:02.768263 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.768247 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="164e3ee6-1460-4818-ad91-bf72c07f386b" containerName="test-curl-7771-139965207975808" Jul 09 16:48:02.768344 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.768266 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="164e3ee6-1460-4818-ad91-bf72c07f386b" containerName="test-curl-7771-139965207975808" Jul 09 16:48:02.768403 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.768382 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="164e3ee6-1460-4818-ad91-bf72c07f386b" containerName="test-curl-7771-139965207975808" Jul 09 16:48:02.771664 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.771634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:02.777877 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.777853 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965207976816"] Jul 09 16:48:02.866758 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.866718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r45ql\" (UniqueName: \"kubernetes.io/projected/09f8c6c1-3ced-4a62-adf0-99ed307791d9-kube-api-access-r45ql\") pod \"test-curl-7771-139965207976816\" (UID: \"09f8c6c1-3ced-4a62-adf0-99ed307791d9\") " pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:02.866912 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.866796 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmbtm\" (UniqueName: \"kubernetes.io/projected/164e3ee6-1460-4818-ad91-bf72c07f386b-kube-api-access-gmbtm\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:48:02.967505 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.967429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r45ql\" (UniqueName: \"kubernetes.io/projected/09f8c6c1-3ced-4a62-adf0-99ed307791d9-kube-api-access-r45ql\") pod \"test-curl-7771-139965207976816\" (UID: \"09f8c6c1-3ced-4a62-adf0-99ed307791d9\") " pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:02.975657 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:02.975624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r45ql\" (UniqueName: \"kubernetes.io/projected/09f8c6c1-3ced-4a62-adf0-99ed307791d9-kube-api-access-r45ql\") pod \"test-curl-7771-139965207976816\" (UID: \"09f8c6c1-3ced-4a62-adf0-99ed307791d9\") " pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:03.085555 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:03.085422 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:03.217519 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:03.217488 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965207976816"] Jul 09 16:48:03.219334 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:48:03.219299 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09f8c6c1_3ced_4a62_adf0_99ed307791d9.slice/crio-42b0e0434e3c817c8ce0ed6480708a8ae637b292cd3e8786d2b170a2d14a96f6 WatchSource:0}: Error finding container 42b0e0434e3c817c8ce0ed6480708a8ae637b292cd3e8786d2b170a2d14a96f6: Status 404 returned error can't find the container with id 42b0e0434e3c817c8ce0ed6480708a8ae637b292cd3e8786d2b170a2d14a96f6 Jul 09 16:48:03.452681 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:03.452652 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7e97b49742f3fd2cc801dee72a001d1640c0d1fae1e075ff7b764be6ef99c2d" Jul 09 16:48:03.452681 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:03.452654 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:48:03.453801 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:03.453770 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965207976816" event={"ID":"09f8c6c1-3ced-4a62-adf0-99ed307791d9","Type":"ContainerStarted","Data":"42b0e0434e3c817c8ce0ed6480708a8ae637b292cd3e8786d2b170a2d14a96f6"} Jul 09 16:48:03.462954 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:48:03.462926 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-139965207975808\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="164e3ee6-1460-4818-ad91-bf72c07f386b" pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:48:03.511054 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:48:03.511018 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-139965207975808\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="164e3ee6-1460-4818-ad91-bf72c07f386b" pod="openshift-ingress/test-curl-7771-139965207975808" Jul 09 16:48:03.512014 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:03.511991 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="164e3ee6-1460-4818-ad91-bf72c07f386b" path="/var/lib/kubelet/pods/164e3ee6-1460-4818-ad91-bf72c07f386b/volumes" Jul 09 16:48:04.459799 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:04.459765 2581 generic.go:356] "Generic (PLEG): container finished" podID="09f8c6c1-3ced-4a62-adf0-99ed307791d9" containerID="0bc12637e0c991826ef2032e590463868de005c5b5b621c1cce88ed13c3c112a" exitCode=0 Jul 09 16:48:04.460169 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:04.459853 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965207976816" event={"ID":"09f8c6c1-3ced-4a62-adf0-99ed307791d9","Type":"ContainerDied","Data":"0bc12637e0c991826ef2032e590463868de005c5b5b621c1cce88ed13c3c112a"} Jul 09 16:48:05.606859 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.606832 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:05.627616 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.627581 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7771-139965207976816_09f8c6c1-3ced-4a62-adf0-99ed307791d9/test-curl-7771-139965207976816/0.log" Jul 09 16:48:05.647824 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.647798 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7771-139965207976816"] Jul 09 16:48:05.651398 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.651378 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7771-139965207976816"] Jul 09 16:48:05.693150 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.693125 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r45ql\" (UniqueName: \"kubernetes.io/projected/09f8c6c1-3ced-4a62-adf0-99ed307791d9-kube-api-access-r45ql\") pod \"09f8c6c1-3ced-4a62-adf0-99ed307791d9\" (UID: \"09f8c6c1-3ced-4a62-adf0-99ed307791d9\") " Jul 09 16:48:05.695256 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.695230 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09f8c6c1-3ced-4a62-adf0-99ed307791d9-kube-api-access-r45ql" (OuterVolumeSpecName: "kube-api-access-r45ql") pod "09f8c6c1-3ced-4a62-adf0-99ed307791d9" (UID: "09f8c6c1-3ced-4a62-adf0-99ed307791d9"). InnerVolumeSpecName "kube-api-access-r45ql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:48:05.772700 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.772616 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7771-139965207976816"] Jul 09 16:48:05.773078 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.773059 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09f8c6c1-3ced-4a62-adf0-99ed307791d9" containerName="test-curl-7771-139965207976816" Jul 09 16:48:05.773167 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.773081 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09f8c6c1-3ced-4a62-adf0-99ed307791d9" containerName="test-curl-7771-139965207976816" Jul 09 16:48:05.773222 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.773166 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="09f8c6c1-3ced-4a62-adf0-99ed307791d9" containerName="test-curl-7771-139965207976816" Jul 09 16:48:05.776200 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.776180 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:05.779810 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.779787 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965207976816"] Jul 09 16:48:05.794595 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.794573 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r45ql\" (UniqueName: \"kubernetes.io/projected/09f8c6c1-3ced-4a62-adf0-99ed307791d9-kube-api-access-r45ql\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:48:05.895782 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.895742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbk6p\" (UniqueName: \"kubernetes.io/projected/d79fd9b5-a55f-4949-bd32-cfe96371a7e3-kube-api-access-vbk6p\") pod \"test-curl-7771-139965207976816\" (UID: \"d79fd9b5-a55f-4949-bd32-cfe96371a7e3\") " pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:05.997030 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:05.996983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbk6p\" (UniqueName: \"kubernetes.io/projected/d79fd9b5-a55f-4949-bd32-cfe96371a7e3-kube-api-access-vbk6p\") pod \"test-curl-7771-139965207976816\" (UID: \"d79fd9b5-a55f-4949-bd32-cfe96371a7e3\") " pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:06.007079 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:06.007057 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbk6p\" (UniqueName: \"kubernetes.io/projected/d79fd9b5-a55f-4949-bd32-cfe96371a7e3-kube-api-access-vbk6p\") pod \"test-curl-7771-139965207976816\" (UID: \"d79fd9b5-a55f-4949-bd32-cfe96371a7e3\") " pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:06.086923 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:06.086843 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:06.219959 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:06.219937 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7771-139965207976816"] Jul 09 16:48:06.222268 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:48:06.222246 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd79fd9b5_a55f_4949_bd32_cfe96371a7e3.slice/crio-a25290d9702575214efd46e3114c5620663b6a72877870b353d93907e09b7fe4 WatchSource:0}: Error finding container a25290d9702575214efd46e3114c5620663b6a72877870b353d93907e09b7fe4: Status 404 returned error can't find the container with id a25290d9702575214efd46e3114c5620663b6a72877870b353d93907e09b7fe4 Jul 09 16:48:06.470727 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:06.470703 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:06.470727 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:06.470724 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42b0e0434e3c817c8ce0ed6480708a8ae637b292cd3e8786d2b170a2d14a96f6" Jul 09 16:48:06.471948 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:06.471923 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965207976816" event={"ID":"d79fd9b5-a55f-4949-bd32-cfe96371a7e3","Type":"ContainerStarted","Data":"a25290d9702575214efd46e3114c5620663b6a72877870b353d93907e09b7fe4"} Jul 09 16:48:06.482624 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:06.482600 2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7771-139965207976816" oldPodUID="09f8c6c1-3ced-4a62-adf0-99ed307791d9" podUID="d79fd9b5-a55f-4949-bd32-cfe96371a7e3" Jul 09 16:48:07.477805 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:07.477768 2581 generic.go:356] "Generic (PLEG): container finished" podID="d79fd9b5-a55f-4949-bd32-cfe96371a7e3" containerID="6fc76f6f6fb7acd7382706ddc4d79956e5f2ccb6d551d25af6aaf4024a008971" exitCode=0 Jul 09 16:48:07.478166 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:07.477815 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7771-139965207976816" event={"ID":"d79fd9b5-a55f-4949-bd32-cfe96371a7e3","Type":"ContainerDied","Data":"6fc76f6f6fb7acd7382706ddc4d79956e5f2ccb6d551d25af6aaf4024a008971"} Jul 09 16:48:07.511516 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:07.511460 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09f8c6c1-3ced-4a62-adf0-99ed307791d9" path="/var/lib/kubelet/pods/09f8c6c1-3ced-4a62-adf0-99ed307791d9/volumes" Jul 09 16:48:08.623838 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:08.623811 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:08.642142 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:08.642117 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7771-139965207976816_d79fd9b5-a55f-4949-bd32-cfe96371a7e3/test-curl-7771-139965207976816/0.log" Jul 09 16:48:08.660768 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:08.660743 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7771-139965207976816"] Jul 09 16:48:08.664223 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:08.664199 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7771-139965207976816"] Jul 09 16:48:08.719587 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:08.719560 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbk6p\" (UniqueName: \"kubernetes.io/projected/d79fd9b5-a55f-4949-bd32-cfe96371a7e3-kube-api-access-vbk6p\") pod \"d79fd9b5-a55f-4949-bd32-cfe96371a7e3\" (UID: \"d79fd9b5-a55f-4949-bd32-cfe96371a7e3\") " Jul 09 16:48:08.721751 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:08.721732 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d79fd9b5-a55f-4949-bd32-cfe96371a7e3-kube-api-access-vbk6p" (OuterVolumeSpecName: "kube-api-access-vbk6p") pod "d79fd9b5-a55f-4949-bd32-cfe96371a7e3" (UID: "d79fd9b5-a55f-4949-bd32-cfe96371a7e3"). InnerVolumeSpecName "kube-api-access-vbk6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:48:08.821155 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:08.821070 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbk6p\" (UniqueName: \"kubernetes.io/projected/d79fd9b5-a55f-4949-bd32-cfe96371a7e3-kube-api-access-vbk6p\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\"" Jul 09 16:48:09.488887 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:09.488858 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a25290d9702575214efd46e3114c5620663b6a72877870b353d93907e09b7fe4" Jul 09 16:48:09.489035 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:09.488896 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:09.498712 ip-10-0-136-0 kubenswrapper[2581]: E0709 16:48:09.498683 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-139965207976816\" is forbidden: User \"system:node:ip-10-0-136-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-0.ec2.internal' and this object" podUID="d79fd9b5-a55f-4949-bd32-cfe96371a7e3" pod="openshift-ingress/test-curl-7771-139965207976816" Jul 09 16:48:09.510319 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:09.510297 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d79fd9b5-a55f-4949-bd32-cfe96371a7e3" path="/var/lib/kubelet/pods/d79fd9b5-a55f-4949-bd32-cfe96371a7e3/volumes" Jul 09 16:48:13.067031 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:13.066998 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:48:26.258139 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:26.258098 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pmlgx"] Jul 09 16:48:29.181870 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:29.181844 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757d6df76f-rsgmb_9efadeea-0e99-448e-a2d3-ae5238b82748/copy-manifests/0.log" Jul 09 16:48:29.187776 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:29.187750 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757d6df76f-rsgmb_9efadeea-0e99-448e-a2d3-ae5238b82748/manager/0.log" Jul 09 16:48:31.230637 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:31.230605 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-628jw_1d604d8c-e91e-47da-97b2-d29d8aa03901/kuadrant-console-plugin/0.log" Jul 09 16:48:31.568236 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:31.568161 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pmlgx_9b90bb88-42a9-4928-9d18-d67a8d3bc7e5/limitador/0.log" Jul 09 16:48:32.352200 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:32.352168 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566b87dd6c-h97wl_4ef98b78-59a2-4778-a12d-63f292e6de04/kube-auth-proxy/0.log" Jul 09 16:48:32.579928 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:32.579884 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-5n99c_564c8ee4-bee6-462d-9a41-d10971cd9663/payload-pre-processing/0.log" Jul 09 16:48:33.260838 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:33.260800 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-b4s62_6a0de3c9-3e8d-4fda-abb0-11d40de8ba9d/main/0.log" Jul 09 16:48:33.475284 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:33.475254 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4bppk_f6835d8d-19e2-4a48-9174-5cdd1a39a736/main/0.log" Jul 09 16:48:40.585750 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:40.585656 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fvv7c_cf5a02de-1a51-4524-a37a-4be5b379712c/global-pull-secret-syncer/0.log" Jul 09 16:48:40.804720 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:40.804693 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p8lkl_97458a95-03a2-4b60-aeef-a34cc99f2218/konnectivity-agent/0.log" Jul 09 16:48:40.874162 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:40.874128 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-0.ec2.internal_28e4344559374a09481bb16f35bd05f6/haproxy/0.log" Jul 09 16:48:43.625554 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:43.625525 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:48:43.633686 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:43.633654 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:48:46.133511 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:46.133481 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-628jw_1d604d8c-e91e-47da-97b2-d29d8aa03901/kuadrant-console-plugin/0.log" Jul 09 16:48:46.331590 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:46.331507 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pmlgx_9b90bb88-42a9-4928-9d18-d67a8d3bc7e5/limitador/0.log" Jul 09 16:48:48.195313 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.195286 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-2qnkg_cef16270-fc30-4eac-b745-b531892da6c4/cluster-monitoring-operator/0.log" Jul 09 16:48:48.252017 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.251993 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-mkjlb_9b0f1015-7265-4919-98f3-874caec0fa27/kube-state-metrics/0.log" Jul 09 16:48:48.308818 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.308788 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-mkjlb_9b0f1015-7265-4919-98f3-874caec0fa27/kube-rbac-proxy-main/0.log" Jul 09 16:48:48.344417 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.344343 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-mkjlb_9b0f1015-7265-4919-98f3-874caec0fa27/kube-rbac-proxy-self/0.log" Jul 09 16:48:48.395045 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.395011 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-mtv6w_f6bad0e4-fc14-4e8f-928b-ac56d0b428ba/monitoring-plugin/0.log" Jul 09 16:48:48.489731 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.489706 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xzl6_b712de0b-2e56-4cd4-b06f-ba3a870f2325/node-exporter/0.log" Jul 09 16:48:48.512126 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.512106 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xzl6_b712de0b-2e56-4cd4-b06f-ba3a870f2325/kube-rbac-proxy/0.log" Jul 09 16:48:48.532202 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.532183 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xzl6_b712de0b-2e56-4cd4-b06f-ba3a870f2325/init-textfile/0.log" Jul 09 16:48:48.627517 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.627491 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-z2ws7_dbc6b7fd-c95c-47fa-8319-76c3e90ef85b/kube-rbac-proxy-main/0.log" Jul 09 16:48:48.650876 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.650856 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-z2ws7_dbc6b7fd-c95c-47fa-8319-76c3e90ef85b/kube-rbac-proxy-self/0.log" Jul 09 16:48:48.669447 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.669429 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-z2ws7_dbc6b7fd-c95c-47fa-8319-76c3e90ef85b/openshift-state-metrics/0.log" Jul 09 16:48:48.702149 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.702128 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d74c20f-e8d6-4cb9-af76-0e689292d1f1/prometheus/0.log" Jul 09 16:48:48.721530 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.721509 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d74c20f-e8d6-4cb9-af76-0e689292d1f1/config-reloader/0.log" Jul 09 16:48:48.742819 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.742796 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d74c20f-e8d6-4cb9-af76-0e689292d1f1/thanos-sidecar/0.log" Jul 09 16:48:48.761389 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.761347 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d74c20f-e8d6-4cb9-af76-0e689292d1f1/kube-rbac-proxy-web/0.log" Jul 09 16:48:48.780201 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.780179 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d74c20f-e8d6-4cb9-af76-0e689292d1f1/kube-rbac-proxy/0.log" Jul 09 16:48:48.800055 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.800013 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d74c20f-e8d6-4cb9-af76-0e689292d1f1/kube-rbac-proxy-thanos/0.log" Jul 09 16:48:48.819240 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.819219 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d74c20f-e8d6-4cb9-af76-0e689292d1f1/init-config-reloader/0.log" Jul 09 16:48:48.888072 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:48.887978 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-h28nv_05dbe0ba-0c40-4356-9344-64e57313cc1d/prometheus-operator-admission-webhook/0.log" Jul 09 16:48:50.227744 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.227707 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-549fd_dc844496-f8de-49e9-90fe-dee1f807df44/networking-console-plugin/0.log" Jul 09 16:48:50.696653 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.696624 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq"] Jul 09 16:48:50.697127 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.697101 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d79fd9b5-a55f-4949-bd32-cfe96371a7e3" containerName="test-curl-7771-139965207976816" Jul 09 16:48:50.697127 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.697122 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d79fd9b5-a55f-4949-bd32-cfe96371a7e3" containerName="test-curl-7771-139965207976816" Jul 09 16:48:50.697335 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.697227 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d79fd9b5-a55f-4949-bd32-cfe96371a7e3" containerName="test-curl-7771-139965207976816" Jul 09 16:48:50.707751 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.707724 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:50.710231 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.710200 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq"] Jul 09 16:48:50.711103 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.711080 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gcfwn\"/\"openshift-service-ca.crt\"" Jul 09 16:48:50.711221 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.711087 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gcfwn\"/\"kube-root-ca.crt\"" Jul 09 16:48:50.711221 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.711089 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gcfwn\"/\"default-dockercfg-6d4ng\"" Jul 09 16:48:50.902378 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.902345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-sys\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:50.902587 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.902407 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-lib-modules\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:50.902587 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.902477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-proc\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:50.902587 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.902541 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7jrd\" (UniqueName: \"kubernetes.io/projected/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-kube-api-access-g7jrd\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:50.902587 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:50.902574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-podres\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.003894 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.003798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-sys\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.003894 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.003874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-lib-modules\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.004122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.003901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-proc\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.004122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.003930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-sys\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.004122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.003941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jrd\" (UniqueName: \"kubernetes.io/projected/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-kube-api-access-g7jrd\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.004122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.003986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-podres\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.004122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.004000 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-proc\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.004122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.004048 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-lib-modules\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.004122 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.004105 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-podres\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.012134 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.012111 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7jrd\" (UniqueName: \"kubernetes.io/projected/2cdecd31-8e0a-401e-bdc2-97c2be8ded0e-kube-api-access-g7jrd\") pod \"perf-node-gather-daemonset-5mgtq\" (UID: \"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e\") " pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.019077 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.019051 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.149142 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.149121 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq"] Jul 09 16:48:51.151157 ip-10-0-136-0 kubenswrapper[2581]: W0709 16:48:51.151126 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2cdecd31_8e0a_401e_bdc2_97c2be8ded0e.slice/crio-420e977fa56673e7ce2008d4a2e340ad6188a858f51d741efe5b405a98330062 WatchSource:0}: Error finding container 420e977fa56673e7ce2008d4a2e340ad6188a858f51d741efe5b405a98330062: Status 404 returned error can't find the container with id 420e977fa56673e7ce2008d4a2e340ad6188a858f51d741efe5b405a98330062 Jul 09 16:48:51.364892 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.364868 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-7skjs_ed0b06bb-ef74-4704-b234-5922d7076132/download-server/0.log" Jul 09 16:48:51.695656 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.695618 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" event={"ID":"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e","Type":"ContainerStarted","Data":"4a2ad16c8947913d9749b0c7cc02183539909dc2a5b3c70fa3a72d3c8c2782af"} Jul 09 16:48:51.695859 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.695676 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" event={"ID":"2cdecd31-8e0a-401e-bdc2-97c2be8ded0e","Type":"ContainerStarted","Data":"420e977fa56673e7ce2008d4a2e340ad6188a858f51d741efe5b405a98330062"} Jul 09 16:48:51.695859 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.695742 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:51.711446 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.711392 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" podStartSLOduration=1.711373501 podStartE2EDuration="1.711373501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:48:51.71069495 +0000 UTC m=+2708.782290911" watchObservedRunningTime="2026-07-09 16:48:51.711373501 +0000 UTC m=+2708.782969451" Jul 09 16:48:51.879103 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:51.879080 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-ftl8n_57d1a803-58e0-4391-9205-aafad12dcd46/volume-data-source-validator/0.log" Jul 09 16:48:52.912035 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:52.912008 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ntv5m_a1ec37ae-7ff5-450e-be11-110cd92c71ad/dns/0.log" Jul 09 16:48:52.935874 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:52.935848 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ntv5m_a1ec37ae-7ff5-450e-be11-110cd92c71ad/kube-rbac-proxy/0.log" Jul 09 16:48:52.959959 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:52.959932 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8nqhq_eef619ed-c5fa-4806-ba7f-c1799b636cc0/dns-node-resolver/0.log" Jul 09 16:48:53.548604 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:53.548577 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hn2fx_f91294fb-ac44-48d8-a7b2-fbb8941bbce9/node-ca/0.log" Jul 09 16:48:54.686912 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:54.686886 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566b87dd6c-h97wl_4ef98b78-59a2-4778-a12d-63f292e6de04/kube-auth-proxy/0.log" Jul 09 16:48:54.792209 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:54.792178 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-5n99c_564c8ee4-bee6-462d-9a41-d10971cd9663/payload-pre-processing/0.log" Jul 09 16:48:55.580690 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:55.580663 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rpd2k_62121c21-50ff-4149-80f8-9fcbd30865d4/serve-healthcheck-canary/0.log" Jul 09 16:48:56.005199 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:56.005162 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-27c27_9f07b5b8-474a-4cb0-98d2-62d11e08dfde/insights-operator/0.log" Jul 09 16:48:56.005685 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:56.005669 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-27c27_9f07b5b8-474a-4cb0-98d2-62d11e08dfde/insights-operator/1.log" Jul 09 16:48:56.155904 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:56.155873 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fwcrs_55d7fdee-5503-4979-8106-92ff9288a1ea/kube-rbac-proxy/0.log" Jul 09 16:48:56.174538 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:56.174515 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fwcrs_55d7fdee-5503-4979-8106-92ff9288a1ea/exporter/0.log" Jul 09 16:48:56.193557 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:56.193537 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fwcrs_55d7fdee-5503-4979-8106-92ff9288a1ea/extractor/0.log" Jul 09 16:48:57.711450 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:57.711424 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gcfwn/perf-node-gather-daemonset-5mgtq" Jul 09 16:48:58.815663 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:58.815631 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757d6df76f-rsgmb_9efadeea-0e99-448e-a2d3-ae5238b82748/manager/0.log" Jul 09 16:48:58.833563 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:58.833540 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757d6df76f-rsgmb_9efadeea-0e99-448e-a2d3-ae5238b82748/copy-manifests/0.log" Jul 09 16:48:59.914249 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:48:59.914214 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85695d7677-92kln_8372755f-9544-4bda-9acb-577a471d2755/manager/0.log" Jul 09 16:49:00.728810 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:00.728774 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566b87dd6c-h97wl_4ef98b78-59a2-4778-a12d-63f292e6de04/kube-auth-proxy/0.log" Jul 09 16:49:00.820137 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:00.820104 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-5n99c_564c8ee4-bee6-462d-9a41-d10971cd9663/payload-pre-processing/0.log" Jul 09 16:49:02.478819 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:02.478789 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566b87dd6c-h97wl_4ef98b78-59a2-4778-a12d-63f292e6de04/kube-auth-proxy/0.log" Jul 09 16:49:02.567236 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:02.567203 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-5n99c_564c8ee4-bee6-462d-9a41-d10971cd9663/payload-pre-processing/0.log" Jul 09 16:49:05.017114 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:05.017077 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hzcbd_8dd22956-4f69-4ebd-932f-55be2e83048d/migrator/0.log" Jul 09 16:49:05.035867 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:05.035838 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hzcbd_8dd22956-4f69-4ebd-932f-55be2e83048d/graceful-termination/0.log" Jul 09 16:49:05.367870 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:05.367837 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-vbzdt_e80700fa-9145-499b-b127-97147a7266cd/kube-storage-version-migrator-operator/1.log" Jul 09 16:49:05.368789 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:05.368773 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-vbzdt_e80700fa-9145-499b-b127-97147a7266cd/kube-storage-version-migrator-operator/0.log" Jul 09 16:49:06.602100 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:06.602067 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xb65r_8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca/kube-multus-additional-cni-plugins/0.log" Jul 09 16:49:06.623055 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:06.623031 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xb65r_8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca/egress-router-binary-copy/0.log" Jul 09 16:49:06.640976 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:06.640956 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xb65r_8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca/cni-plugins/0.log" Jul 09 16:49:06.658540 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:06.658516 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xb65r_8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca/bond-cni-plugin/0.log" Jul 09 16:49:06.676081 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:06.676062 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xb65r_8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca/routeoverride-cni/0.log" Jul 09 16:49:06.693922 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:06.693896 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xb65r_8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca/whereabouts-cni-bincopy/0.log" Jul 09 16:49:06.712003 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:06.711983 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xb65r_8a5ec4f5-3080-4fd6-a6d3-9ec460b706ca/whereabouts-cni/0.log" Jul 09 16:49:06.805690 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:06.805663 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z95sg_4ab0b329-22ff-4c9f-b350-73462deaae48/kube-multus/0.log" Jul 09 16:49:06.867159 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:06.867128 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k74h8_865c284a-ea51-4053-9d3e-32524736479b/network-metrics-daemon/0.log" Jul 09 16:49:06.888211 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:06.888182 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k74h8_865c284a-ea51-4053-9d3e-32524736479b/kube-rbac-proxy/0.log" Jul 09 16:49:07.911082 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:07.911054 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-controller/0.log" Jul 09 16:49:07.926058 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:07.926032 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/1.log" Jul 09 16:49:07.926058 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:07.926046 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovn-acl-logging/0.log" Jul 09 16:49:07.944644 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:07.944619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/kube-rbac-proxy-node/0.log" Jul 09 16:49:07.963025 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:07.963000 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 16:49:07.980188 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:07.980166 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/northd/0.log" Jul 09 16:49:07.998294 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:07.998268 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/nbdb/0.log" Jul 09 16:49:08.018940 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:08.018920 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/sbdb/0.log" Jul 09 16:49:08.062645 ip-10-0-136-0 kubenswrapper[2581]: I0709 16:49:08.062622 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbvp4_244c6150-ca46-4324-9b34-b5e812e5dd40/ovnkube-controller/0.log"