Jul 03 19:08:08.126813 ip-10-0-132-110 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 03 19:08:08.126825 ip-10-0-132-110 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 03 19:08:08.126836 ip-10-0-132-110 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 03 19:08:08.127178 ip-10-0-132-110 systemd[1]: Failed to start Kubernetes Kubelet. Jul 03 19:08:18.337725 ip-10-0-132-110 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 03 19:08:18.337741 ip-10-0-132-110 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ad461c2efca548cb96bb12c2c0a03750 -- Jul 03 19:09:52.801267 ip-10-0-132-110 systemd[1]: Starting Kubernetes Kubelet... Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.227323 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230835 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230846 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230849 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230853 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230855 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230858 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230861 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230863 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:53.348578 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230866 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:53.307176 ip-10-0-132-110 systemd[1]: Started Kubernetes Kubelet. Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230868 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230871 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230873 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230876 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230878 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230880 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230883 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230885 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230889 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230891 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230894 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230898 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230901 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230904 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230907 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230909 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230912 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230915 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230917 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:53.349968 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230919 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230922 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230924 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230927 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230930 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230933 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230935 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230938 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230940 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230943 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230945 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230948 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230951 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230954 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230957 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230960 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230962 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230964 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230967 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:53.513951 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230969 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230972 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230975 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230977 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230980 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230995 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.230998 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231001 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231003 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231006 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231008 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231011 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231013 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231016 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231020 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231023 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231026 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231028 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231031 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:53.514793 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231034 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231036 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231039 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231042 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231044 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231047 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231050 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231053 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231055 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231058 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231060 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231063 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231066 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231068 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231072 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231078 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231082 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231086 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231089 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:53.515461 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231091 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231095 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231098 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231101 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231104 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231107 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231109 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231112 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231115 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231118 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231120 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231123 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231125 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231128 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231801 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231808 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231811 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231814 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231817 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:53.516297 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231820 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231823 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231825 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231828 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231830 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231833 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231836 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231838 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231840 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231843 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231846 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231848 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231850 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231853 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231855 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231858 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231861 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231864 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231867 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231869 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:53.516941 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231871 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231874 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231877 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231879 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231882 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231884 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231887 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231889 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231892 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231894 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231897 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231899 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231902 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231905 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231907 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231910 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231912 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231915 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231917 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:53.517769 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231919 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231922 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231927 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231931 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231934 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231937 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231940 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231942 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231945 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231948 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231952 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231955 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231958 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231961 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231964 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231966 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231969 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231971 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231974 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:53.518362 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231977 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231979 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.231997 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232002 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232005 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232008 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232013 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232015 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232018 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232021 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232023 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232026 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232028 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232031 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232033 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232036 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232038 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232041 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232044 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:53.518997 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232047 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232049 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232052 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232054 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232057 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232059 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232062 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232064 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232067 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232069 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232072 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232074 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232076 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232079 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232081 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232084 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232086 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232433 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232439 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232445 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:53.519629 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232449 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232453 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232456 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232458 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232461 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232464 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232467 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232469 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232472 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232474 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232477 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232479 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232483 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232486 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232488 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232491 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232493 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232496 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232499 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232501 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:53.520444 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232504 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232506 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232509 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232511 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232513 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232516 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232518 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232521 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232523 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232526 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232528 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232532 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232534 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232538 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232541 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232544 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232546 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232549 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232553 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:53.521285 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232556 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232559 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232562 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232564 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232567 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232571 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232574 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232576 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232579 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232582 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232585 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232587 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232590 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232593 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232596 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232598 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232601 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232605 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232607 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232609 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:53.521904 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232612 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232614 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232618 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232620 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232624 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232626 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232629 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232631 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232641 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232643 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232646 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232648 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232651 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232653 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232656 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232658 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232661 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232663 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232666 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232668 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:53.522701 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232671 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232673 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232676 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232678 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232680 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232683 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232685 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232688 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232690 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232695 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232697 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232699 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232702 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232704 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232707 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232709 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.232713 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232784 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232795 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232800 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232804 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 03 19:09:53.523283 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232819 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232822 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232828 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232833 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232836 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232838 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232842 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232845 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232848 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232850 2580 flags.go:64] FLAG: --cgroup-root="" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232853 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232856 2580 flags.go:64] FLAG: --client-ca-file="" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232859 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232861 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232866 2580 flags.go:64] FLAG: --cluster-domain="" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232869 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232872 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232875 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232878 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232881 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232886 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232889 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232892 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232895 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 03 19:09:53.523834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232898 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232901 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232904 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232908 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232912 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232914 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232917 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232920 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232923 2580 flags.go:64] FLAG: --enable-server="true" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232926 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232930 2580 flags.go:64] FLAG: --event-burst="100" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232933 2580 flags.go:64] FLAG: --event-qps="50" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232936 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232939 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232941 2580 flags.go:64] FLAG: --eviction-hard="" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232945 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232948 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232951 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232953 2580 flags.go:64] FLAG: --eviction-soft="" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232956 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232959 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232961 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232964 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232967 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232970 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 03 19:09:53.524497 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232972 2580 flags.go:64] FLAG: --feature-gates="" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232976 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232979 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232996 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.232999 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233002 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233005 2580 flags.go:64] FLAG: --help="false" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233008 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233011 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233014 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233018 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233022 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233025 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233028 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233030 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233033 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233036 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233039 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233042 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233045 2580 flags.go:64] FLAG: --kube-reserved="" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233048 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233051 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233054 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233057 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 03 19:09:53.525182 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233060 2580 flags.go:64] FLAG: --lock-file="" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233062 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233065 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233068 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233073 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233075 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233078 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233081 2580 flags.go:64] FLAG: --logging-format="text" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233083 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233087 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233089 2580 flags.go:64] FLAG: --manifest-url="" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233093 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233097 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233100 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233104 2580 flags.go:64] FLAG: --max-pods="110" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233107 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233110 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233112 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233117 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233120 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233122 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233125 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233132 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233135 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233137 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 03 19:09:53.525819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233140 2580 flags.go:64] FLAG: --pod-cidr="" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233144 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233149 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233152 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233155 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233158 2580 flags.go:64] FLAG: --port="10250" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233161 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233163 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02203e318ca1853fe" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233166 2580 flags.go:64] FLAG: --qos-reserved="" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233169 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233172 2580 flags.go:64] FLAG: --register-node="true" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233175 2580 flags.go:64] FLAG: --register-with-taints="" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233178 2580 flags.go:64] FLAG: --registry-burst="10" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233181 2580 flags.go:64] FLAG: --registry-qps="5" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233183 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233186 2580 flags.go:64] FLAG: --reserved-memory="" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233190 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233193 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233197 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233200 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233203 2580 flags.go:64] FLAG: --runonce="false" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233205 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233208 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233211 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233214 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 03 19:09:53.526791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233217 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233221 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233223 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233227 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233229 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233232 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233235 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233238 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233240 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233244 2580 flags.go:64] FLAG: --system-cgroups="" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233246 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233251 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233254 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233257 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233261 2580 flags.go:64] FLAG: --tls-min-version="" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233263 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233266 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233269 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233271 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233274 2580 flags.go:64] FLAG: --v="2" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233278 2580 flags.go:64] FLAG: --version="false" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233282 2580 flags.go:64] FLAG: --vmodule="" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233285 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233288 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 03 19:09:53.527479 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233404 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233410 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233413 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233416 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233419 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233421 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233424 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233426 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233429 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233432 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233435 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233437 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233440 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233442 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233445 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233448 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233450 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233453 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233456 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233459 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:53.624636 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233461 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233464 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233467 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233469 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233472 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233474 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233477 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233479 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233482 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233484 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233487 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233489 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233492 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233496 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233498 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233500 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233503 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233505 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233508 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233511 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:53.625431 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233513 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233517 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233520 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233522 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233525 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233527 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233529 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233533 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233535 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233537 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233540 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233543 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233546 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233548 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233550 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233554 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233558 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233561 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:53.626042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233564 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233568 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233572 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233575 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233577 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233580 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233583 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233586 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233589 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233591 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233594 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233596 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233599 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233601 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233604 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233608 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233610 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233613 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233615 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:53.626543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233618 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233620 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233623 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233625 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233628 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233630 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233632 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233636 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233638 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233640 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233643 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233645 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233648 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233650 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233653 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233656 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233658 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233660 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233663 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233665 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:53.627042 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233669 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.233672 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.233677 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.240505 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.240521 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.240539 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.240548 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240617 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240621 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240625 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240628 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240631 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240634 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240637 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240640 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:53.627639 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240642 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240645 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240648 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240653 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240656 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240659 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240662 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240665 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240667 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240670 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240673 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240675 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240677 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240680 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240683 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240687 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240690 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240693 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240698 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240700 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:53.628082 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240703 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240711 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240714 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240717 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240719 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240721 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240724 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240726 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240729 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240731 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240734 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240736 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240739 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240742 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240744 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240749 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240753 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240755 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240758 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:53.628797 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240761 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240764 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240766 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240769 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240771 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240774 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240776 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240779 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240781 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240784 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240786 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240791 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240793 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240796 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240799 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240807 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240811 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240814 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240817 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:53.629315 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240819 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240822 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240824 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240827 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240829 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240831 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240834 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240836 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240839 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240843 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240846 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240848 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240850 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240853 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240855 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240858 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240861 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240863 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240865 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240868 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:53.629830 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240870 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240873 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240875 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240877 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240881 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240884 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240886 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240889 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240891 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240904 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240907 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240910 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.240912 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.240917 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241080 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:53.630352 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241086 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241089 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241092 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241095 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241098 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241101 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241106 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241108 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241111 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241113 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241116 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241119 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241121 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241124 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241126 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241129 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241131 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241134 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241136 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241138 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:53.630794 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241141 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241143 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241147 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241150 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241152 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241154 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241157 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241165 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241168 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241170 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241173 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241175 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241178 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241180 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241182 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241185 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241187 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241190 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241194 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241196 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:53.631322 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241199 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241201 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241204 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241206 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241208 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241211 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241213 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241216 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241218 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241221 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241223 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241226 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241228 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241232 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241237 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241240 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241242 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241245 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241247 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241250 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:53.631873 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241258 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241260 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241262 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241265 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241267 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241270 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241272 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241275 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241278 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241280 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241284 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241287 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241291 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241294 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241297 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241299 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241302 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241304 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241307 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:53.632414 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241309 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241312 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241314 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241316 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241319 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241321 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241323 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241327 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241330 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241332 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241335 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241337 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241340 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241342 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241350 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241353 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241355 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241358 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:53.632925 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:53.241360 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.241365 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.241476 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.243751 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.245936 2580 server.go:1019] "Starting client certificate rotation" Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.246049 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.246086 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.250021 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.253296 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.270435 2580 log.go:25] "Validated CRI v1 runtime API" Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.272545 2580 log.go:25] "Validated CRI v1 image API" Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.273326 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 03 19:09:53.633412 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.277911 2580 fs.go:135] Filesystem UUIDs: map[758fc696-bde1-44bc-bf7f-7ee4dec34688:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bcb29fed-9191-49ff-a822-4cd32b191ce1:/dev/nvme0n1p3] Jul 03 19:09:53.633777 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.277931 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 03 19:09:53.633845 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.285542 2580 manager.go:216] Machine: {Timestamp:2026-07-03 19:09:53.284164037 +0000 UTC m=+0.352738946 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3203065 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29f94fb2917c88ba5fa65e29fcacb3 SystemUUID:ec29f94f-b291-7c88-ba5f-a65e29fcacb3 BootID:ad461c2e-fca5-48cb-96bb-12c2c0a03750 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:d3:cf:f0:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:d3:cf:f0:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:46:5d:3c:1b:0b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 03 19:09:53.633845 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.285634 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 03 19:09:53.633845 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.285705 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 03 19:09:53.633845 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.287387 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 03 19:09:53.633845 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.287406 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 03 19:09:53.633845 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.288154 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 03 19:09:53.633845 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.288163 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 03 19:09:53.633845 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.288171 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.288969 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.290132 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.292941 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.293064 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.293867 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.293876 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.293890 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.293898 2580 kubelet.go:398] "Adding apiserver pod source" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.293907 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.294219 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.294234 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.297461 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.300237 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.300264 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301674 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301709 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301716 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301722 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301731 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301744 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301757 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301765 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301774 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301783 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301801 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301807 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.301974 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.302686 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.302702 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.306285 2580 server.go:1268] "Started kubelet" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.306354 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.306386 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.306443 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.307077 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.307093 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.307142 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.307413 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.307607 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 03 19:09:53.634156 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.311688 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.313194 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.313240 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.313580 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.313951 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.313975 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.313952 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.314086 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.314094 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.316037 2580 factory.go:55] Registering systemd factory Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.316114 2580 factory.go:223] Registration of the systemd container factory successfully Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.316276 2580 factory.go:153] Registering CRI-O factory Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.316287 2580 factory.go:223] Registration of the crio container factory successfully Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.316327 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.316343 2580 factory.go:103] Registering Raw factory Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.316353 2580 manager.go:1196] Started watching for new ooms in manager Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.317005 2580 manager.go:349] Starting recovery of all containers Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.316173 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-110.ec2.internal.18bedd458ef39ed4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-110.ec2.internal,UID:ip-10-0-132-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-110.ec2.internal,},FirstTimestamp:2026-07-03 19:09:53.306107604 +0000 UTC m=+0.374682493,LastTimestamp:2026-07-03 19:09:53.306107604 +0000 UTC m=+0.374682493,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-110.ec2.internal,}" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.320588 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.320664 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.323056 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ccwb2" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.329825 2580 manager.go:354] Recovery completed Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.331118 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ccwb2" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.334884 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.336741 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.336773 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.336788 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.337378 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.337390 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.337408 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.337415 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.338158 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:53.635402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.338181 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.338191 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.338473 2580 policy_none.go:49] "None policy: Start" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.338489 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.338502 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.338757 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-110.ec2.internal.18bedd4590c74ae7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-110.ec2.internal,UID:ip-10-0-132-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-110.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-110.ec2.internal,},FirstTimestamp:2026-07-03 19:09:53.336756967 +0000 UTC m=+0.405331858,LastTimestamp:2026-07-03 19:09:53.336756967 +0000 UTC m=+0.405331858,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-110.ec2.internal,}" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.339580 2580 policy_none.go:47] "Start" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.381606 2580 manager.go:337] "Starting Device Plugin manager" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.381639 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.381649 2580 server.go:87] "Starting device plugin registration server" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.381867 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.381881 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.381967 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.382105 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.382112 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.382679 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.382730 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.450855 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.451980 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.452031 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.452053 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.452086 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.454378 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.482370 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.483296 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.483329 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.483339 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.483360 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.491901 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.491920 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-110.ec2.internal\": node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.508197 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.552967 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-110.ec2.internal"] Jul 03 19:09:53.765854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.553191 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.554830 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.554857 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.554866 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.556044 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.556156 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.556183 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.557067 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.557085 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.557097 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.557070 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.557153 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.557162 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.558199 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.558223 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.558855 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.558881 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.558894 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.587519 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-110.ec2.internal\" not found" node="ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.591650 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-110.ec2.internal\" not found" node="ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.608300 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.616352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c86dee383fa021146df2b7324b62c96f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal\" (UID: \"c86dee383fa021146df2b7324b62c96f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.616372 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c86dee383fa021146df2b7324b62c96f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal\" (UID: \"c86dee383fa021146df2b7324b62c96f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.616387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eeb56b029090ca0ee8dbd6a71a52c6ad-config\") pod \"kube-apiserver-proxy-ip-10-0-132-110.ec2.internal\" (UID: \"eeb56b029090ca0ee8dbd6a71a52c6ad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.709056 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:53.770691 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.717412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eeb56b029090ca0ee8dbd6a71a52c6ad-config\") pod \"kube-apiserver-proxy-ip-10-0-132-110.ec2.internal\" (UID: \"eeb56b029090ca0ee8dbd6a71a52c6ad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.771444 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.717431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c86dee383fa021146df2b7324b62c96f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal\" (UID: \"c86dee383fa021146df2b7324b62c96f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.771444 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.717449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c86dee383fa021146df2b7324b62c96f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal\" (UID: \"c86dee383fa021146df2b7324b62c96f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.771444 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.717493 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c86dee383fa021146df2b7324b62c96f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal\" (UID: \"c86dee383fa021146df2b7324b62c96f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.771444 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.717534 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c86dee383fa021146df2b7324b62c96f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal\" (UID: \"c86dee383fa021146df2b7324b62c96f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.771444 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.717523 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eeb56b029090ca0ee8dbd6a71a52c6ad-config\") pod \"kube-apiserver-proxy-ip-10-0-132-110.ec2.internal\" (UID: \"eeb56b029090ca0ee8dbd6a71a52c6ad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.903112 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.809836 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:53.903112 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.890351 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" Jul 03 19:09:53.903112 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:53.894141 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-110.ec2.internal" Jul 03 19:09:54.006618 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:53.910783 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:54.012465 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:54.011149 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:54.119265 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:54.111664 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:54.218957 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:54.212234 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:54.300814 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:54.244649 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 03 19:09:54.300814 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:54.244798 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 03 19:09:55.943955 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:54.334883 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-110.ec2.internal\" not found" Jul 03 19:09:55.943955 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:54.337022 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 19:04:54 +0000 UTC" deadline="2028-01-02 11:10:03.59909193 +0000 UTC" Jul 03 19:09:55.943955 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:54.337046 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13144h0m9.262048118s" Jul 03 19:09:56.019476 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:55.990439 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:09:56.088813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.086711 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" Jul 03 19:09:56.098152 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.097762 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 19:09:56.101445 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.099698 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-110.ec2.internal" Jul 03 19:09:56.186672 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:56.102985 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86dee383fa021146df2b7324b62c96f.slice/crio-18026516ad6583996a5a9dc7f8b1a748b8fcc13254af31538ff0aab422547996 WatchSource:0}: Error finding container 18026516ad6583996a5a9dc7f8b1a748b8fcc13254af31538ff0aab422547996: Status 404 returned error can't find the container with id 18026516ad6583996a5a9dc7f8b1a748b8fcc13254af31538ff0aab422547996 Jul 03 19:09:56.186672 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.109038 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 19:09:56.186672 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.109696 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 19:09:56.186672 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:56.126997 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb56b029090ca0ee8dbd6a71a52c6ad.slice/crio-fd7701e0b617348a9a63038e63608a7b703fc27cc5e88bddfaa9430dbb5311e6 WatchSource:0}: Error finding container fd7701e0b617348a9a63038e63608a7b703fc27cc5e88bddfaa9430dbb5311e6: Status 404 returned error can't find the container with id fd7701e0b617348a9a63038e63608a7b703fc27cc5e88bddfaa9430dbb5311e6 Jul 03 19:09:56.186672 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.148968 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:09:56.276960 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.266958 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:09:56.868579 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.868319 2580 apiserver.go:52] "Watching apiserver" Jul 03 19:09:56.874938 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.874909 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 03 19:09:56.875343 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.875312 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-s5d5p","openshift-multus/multus-additional-cni-plugins-krpln","openshift-multus/multus-hlfrb","openshift-network-operator/iptables-alerter-j4qk5","openshift-ovn-kubernetes/ovnkube-node-rvfrf","kube-system/konnectivity-agent-qlbwl","kube-system/kube-apiserver-proxy-ip-10-0-132-110.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d","openshift-dns/node-resolver-782f6","openshift-image-registry/node-ca-v68d2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal","openshift-multus/network-metrics-daemon-qjp6f","openshift-network-diagnostics/network-check-target-q9zg2","kube-system/global-pull-secret-syncer-xhjjv"] Jul 03 19:09:56.876981 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.876962 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v68d2" Jul 03 19:09:56.878460 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.878310 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:09:56.878460 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:56.878395 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:09:56.879359 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.879338 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 03 19:09:56.879583 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.879556 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.880337 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.880308 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 03 19:09:56.880526 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.880252 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 03 19:09:56.880683 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.880664 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c6v78\"" Jul 03 19:09:56.882220 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.882195 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j4qk5" Jul 03 19:09:56.883356 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.883335 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hqt62\"" Jul 03 19:09:56.883713 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.883696 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 03 19:09:56.883793 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.883754 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 03 19:09:56.883922 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.883907 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 03 19:09:56.884016 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.883996 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 03 19:09:56.884087 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.884019 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.884276 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.884248 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:09:56.885247 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.885222 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 03 19:09:56.885780 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.885599 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 03 19:09:56.886243 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.886046 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 03 19:09:56.886243 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.886080 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4tfbh\"" Jul 03 19:09:56.886394 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.886381 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 03 19:09:56.886777 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.886455 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 03 19:09:56.886777 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.886508 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 03 19:09:56.886949 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.886868 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 03 19:09:56.886949 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.886904 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 03 19:09:56.887382 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.887365 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:09:56.888851 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.888641 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xvcx6\"" Jul 03 19:09:56.889708 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.889692 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-782f6" Jul 03 19:09:56.889820 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.889772 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 03 19:09:56.890358 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.890315 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 03 19:09:56.890532 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.890496 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g74fj\"" Jul 03 19:09:56.891754 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.891734 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:56.891878 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:56.891814 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:09:56.892151 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.892017 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8zrnv\"" Jul 03 19:09:56.892151 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.892084 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 03 19:09:56.892151 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.892127 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 03 19:09:56.893610 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.893592 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:56.897163 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.895417 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 03 19:09:56.897163 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.895632 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 03 19:09:56.897163 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.895806 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6sbfv\"" Jul 03 19:09:56.897163 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.896709 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:56.898903 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.898884 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:56.899131 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.899116 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 03 19:09:56.899298 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.899189 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:09:56.899298 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.899296 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s8n75\"" Jul 03 19:09:56.900787 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.900771 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:09:56.901061 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:56.901040 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:09:56.901230 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.900946 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 03 19:09:56.901337 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.900818 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 03 19:09:56.901401 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.901340 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 03 19:09:56.901401 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.901080 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bhgpv\"" Jul 03 19:09:56.906654 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.906632 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmcvf\" (UniqueName: \"kubernetes.io/projected/397a08fc-3cf1-4f0b-aca2-d4b203a56fcf-kube-api-access-fmcvf\") pod \"iptables-alerter-j4qk5\" (UID: \"397a08fc-3cf1-4f0b-aca2-d4b203a56fcf\") " pod="openshift-network-operator/iptables-alerter-j4qk5" Jul 03 19:09:56.906757 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.906670 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-kubelet\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.906757 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.906693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-systemd-units\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.906757 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.906718 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-slash\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.906757 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.906740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-run-systemd\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.906968 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.906839 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-cni-bin\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.906968 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.906864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e93e7739-0a8b-4f3f-9a04-6dfdef436237-serviceca\") pod \"node-ca-v68d2\" (UID: \"e93e7739-0a8b-4f3f-9a04-6dfdef436237\") " pod="openshift-image-registry/node-ca-v68d2" Jul 03 19:09:56.906968 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.906907 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-run-k8s-cni-cncf-io\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.906968 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.906965 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-conf-dir\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.907139 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.906988 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-etc-kubernetes\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.907139 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.907044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/397a08fc-3cf1-4f0b-aca2-d4b203a56fcf-host-slash\") pod \"iptables-alerter-j4qk5\" (UID: \"397a08fc-3cf1-4f0b-aca2-d4b203a56fcf\") " pod="openshift-network-operator/iptables-alerter-j4qk5" Jul 03 19:09:56.907139 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.907077 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-var-lib-openvswitch\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.907288 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.907151 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-node-log\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.907288 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.907173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-cni-dir\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.907351 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.907322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-run-multus-certs\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.907395 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.907351 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-ovn-node-metrics-cert\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.907395 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.907239 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 03 19:09:56.907741 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.907376 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v69x\" (UniqueName: \"kubernetes.io/projected/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-kube-api-access-6v69x\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.908023 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ffefdb25-0ec3-4dda-9d05-df25861106dc-agent-certs\") pod \"konnectivity-agent-qlbwl\" (UID: \"ffefdb25-0ec3-4dda-9d05-df25861106dc\") " pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:09:56.908094 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ffefdb25-0ec3-4dda-9d05-df25861106dc-konnectivity-ca\") pod \"konnectivity-agent-qlbwl\" (UID: \"ffefdb25-0ec3-4dda-9d05-df25861106dc\") " pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:09:56.908094 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e93e7739-0a8b-4f3f-9a04-6dfdef436237-host\") pod \"node-ca-v68d2\" (UID: \"e93e7739-0a8b-4f3f-9a04-6dfdef436237\") " pod="openshift-image-registry/node-ca-v68d2" Jul 03 19:09:56.908094 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908087 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-system-cni-dir\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.908289 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908108 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-os-release\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.908289 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-cni-binary-copy\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.908289 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908152 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-socket-dir-parent\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.908289 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-run-netns\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.908289 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shzbn\" (UniqueName: \"kubernetes.io/projected/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-kube-api-access-shzbn\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.908289 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908219 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46f29\" (UniqueName: \"kubernetes.io/projected/e93e7739-0a8b-4f3f-9a04-6dfdef436237-kube-api-access-46f29\") pod \"node-ca-v68d2\" (UID: \"e93e7739-0a8b-4f3f-9a04-6dfdef436237\") " pod="openshift-image-registry/node-ca-v68d2" Jul 03 19:09:56.908289 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvfcv\" (UniqueName: \"kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv\") pod \"network-check-target-q9zg2\" (UID: \"68574744-4659-43b3-8b40-02421ad57599\") " pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:09:56.908634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-var-lib-kubelet\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.908634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-hostroot\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.908634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908372 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-run-ovn\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.908634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-log-socket\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.908634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908420 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.908634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-ovnkube-script-lib\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.908634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908500 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-var-lib-cni-multus\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.908634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908529 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-run-netns\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.908634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-ovnkube-config\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.908634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-cnibin\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.908634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.909040 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-env-overrides\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.909040 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-daemon-config\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.909040 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-etc-openvswitch\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.909040 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908749 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-run-openvswitch\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.909040 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-cni-netd\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:56.909040 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-var-lib-cni-bin\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:56.909040 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.908823 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/397a08fc-3cf1-4f0b-aca2-d4b203a56fcf-iptables-alerter-script\") pod \"iptables-alerter-j4qk5\" (UID: \"397a08fc-3cf1-4f0b-aca2-d4b203a56fcf\") " pod="openshift-network-operator/iptables-alerter-j4qk5" Jul 03 19:09:56.916596 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.916573 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 19:09:56.935363 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.935328 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m7rtd" Jul 03 19:09:56.941850 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.941565 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m7rtd" Jul 03 19:09:56.988558 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:56.988524 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 03 19:09:57.009147 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009112 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-cni-dir\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.009147 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-run-multus-certs\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.009354 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-ovn-node-metrics-cert\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.009354 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009191 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ffefdb25-0ec3-4dda-9d05-df25861106dc-konnectivity-ca\") pod \"konnectivity-agent-qlbwl\" (UID: \"ffefdb25-0ec3-4dda-9d05-df25861106dc\") " pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:09:57.009354 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009208 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-systemd\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.009354 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009223 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.009354 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-os-release\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.009354 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009253 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-cni-binary-copy\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.009354 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009281 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-run-netns\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.009354 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-log-socket\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.009354 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e25bd906-a7c7-4493-ba18-b869f04781eb-tmp\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.009354 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn85x\" (UniqueName: \"kubernetes.io/projected/e25bd906-a7c7-4493-ba18-b869f04781eb-kube-api-access-jn85x\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009368 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46f29\" (UniqueName: \"kubernetes.io/projected/e93e7739-0a8b-4f3f-9a04-6dfdef436237-kube-api-access-46f29\") pod \"node-ca-v68d2\" (UID: \"e93e7739-0a8b-4f3f-9a04-6dfdef436237\") " pod="openshift-image-registry/node-ca-v68d2" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009399 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-cni-dir\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009414 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-var-lib-kubelet\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-run-ovn\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009462 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-var-lib-kubelet\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009510 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-run-multus-certs\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009577 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-run-ovn\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009615 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.009786 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009654 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-run-netns\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.010403 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.009860 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 03 19:09:57.010403 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010135 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-log-socket\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.010403 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010201 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ffefdb25-0ec3-4dda-9d05-df25861106dc-konnectivity-ca\") pod \"konnectivity-agent-qlbwl\" (UID: \"ffefdb25-0ec3-4dda-9d05-df25861106dc\") " pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:09:57.010403 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010314 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-os-release\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.010590 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hxsn\" (UniqueName: \"kubernetes.io/projected/de0f9289-f59a-4261-8d85-80f74636a3b0-kube-api-access-2hxsn\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.010590 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010523 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-device-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.010590 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010550 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-ovnkube-config\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.010590 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-system-cni-dir\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.010590 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-cnibin\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-env-overrides\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010620 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48da5a1e-f8a6-476c-b815-f0388f0ebb67-dbus\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-run\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-sys\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010659 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-host\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-socket-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-daemon-config\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-run-openvswitch\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-modprobe-d\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010760 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de0f9289-f59a-4261-8d85-80f74636a3b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010781 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-var-lib-cni-bin\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010783 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-cni-binary-copy\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/397a08fc-3cf1-4f0b-aca2-d4b203a56fcf-iptables-alerter-script\") pod \"iptables-alerter-j4qk5\" (UID: \"397a08fc-3cf1-4f0b-aca2-d4b203a56fcf\") " pod="openshift-network-operator/iptables-alerter-j4qk5" Jul 03 19:09:57.010813 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010811 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-slash\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.011455 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.010844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-run-systemd\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.011455 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011187 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-daemon-config\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.011455 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011236 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-run-openvswitch\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.011455 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011283 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-var-lib-cni-bin\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.011455 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011343 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-ovnkube-config\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.011455 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011406 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-slash\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.011455 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011447 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-cni-bin\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74dce66b-24ed-4967-a4a2-8b7710b45015-hosts-file\") pod \"node-resolver-782f6\" (UID: \"74dce66b-24ed-4967-a4a2-8b7710b45015\") " pod="openshift-dns/node-resolver-782f6" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48da5a1e-f8a6-476c-b815-f0388f0ebb67-kubelet-config\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011532 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de0f9289-f59a-4261-8d85-80f74636a3b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-conf-dir\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-etc-kubernetes\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/397a08fc-3cf1-4f0b-aca2-d4b203a56fcf-host-slash\") pod \"iptables-alerter-j4qk5\" (UID: \"397a08fc-3cf1-4f0b-aca2-d4b203a56fcf\") " pod="openshift-network-operator/iptables-alerter-j4qk5" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-var-lib-openvswitch\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-node-log\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011700 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scv27\" (UniqueName: \"kubernetes.io/projected/74dce66b-24ed-4967-a4a2-8b7710b45015-kube-api-access-scv27\") pod \"node-resolver-782f6\" (UID: \"74dce66b-24ed-4967-a4a2-8b7710b45015\") " pod="openshift-dns/node-resolver-782f6" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011704 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/397a08fc-3cf1-4f0b-aca2-d4b203a56fcf-iptables-alerter-script\") pod \"iptables-alerter-j4qk5\" (UID: \"397a08fc-3cf1-4f0b-aca2-d4b203a56fcf\") " pod="openshift-network-operator/iptables-alerter-j4qk5" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011723 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-sysctl-conf\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v69x\" (UniqueName: \"kubernetes.io/projected/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-kube-api-access-6v69x\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011756 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-cnibin\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.011833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e93e7739-0a8b-4f3f-9a04-6dfdef436237-host\") pod \"node-ca-v68d2\" (UID: \"e93e7739-0a8b-4f3f-9a04-6dfdef436237\") " pod="openshift-image-registry/node-ca-v68d2" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-system-cni-dir\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-socket-dir-parent\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shzbn\" (UniqueName: \"kubernetes.io/projected/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-kube-api-access-shzbn\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011959 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-ovnkube-script-lib\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.011998 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-registration-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012018 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-env-overrides\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012024 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjrfr\" (UniqueName: \"kubernetes.io/projected/f18c8179-6720-4e16-84aa-5c360dcf7a9a-kube-api-access-wjrfr\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfcv\" (UniqueName: \"kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv\") pod \"network-check-target-q9zg2\" (UID: \"68574744-4659-43b3-8b40-02421ad57599\") " pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012065 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e93e7739-0a8b-4f3f-9a04-6dfdef436237-host\") pod \"node-ca-v68d2\" (UID: \"e93e7739-0a8b-4f3f-9a04-6dfdef436237\") " pod="openshift-image-registry/node-ca-v68d2" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012076 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-hostroot\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012089 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-conf-dir\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012100 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-lib-modules\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012109 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-run-systemd\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.012472 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-var-lib-cni-multus\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012150 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-run-netns\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-os-release\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012197 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012219 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-etc-selinux\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-etc-openvswitch\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012297 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-cni-netd\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012311 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-kubernetes\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012335 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-sysctl-d\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-tuned\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012413 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-node-log\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012431 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de0f9289-f59a-4261-8d85-80f74636a3b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmcvf\" (UniqueName: \"kubernetes.io/projected/397a08fc-3cf1-4f0b-aca2-d4b203a56fcf-kube-api-access-fmcvf\") pod \"iptables-alerter-j4qk5\" (UID: \"397a08fc-3cf1-4f0b-aca2-d4b203a56fcf\") " pod="openshift-network-operator/iptables-alerter-j4qk5" Jul 03 19:09:57.013068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-kubelet\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012486 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-systemd-units\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-var-lib-kubelet\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2x4z\" (UniqueName: \"kubernetes.io/projected/e2c304af-54b0-4055-ad6f-36fe5e26f447-kube-api-access-k2x4z\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012542 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e93e7739-0a8b-4f3f-9a04-6dfdef436237-serviceca\") pod \"node-ca-v68d2\" (UID: \"e93e7739-0a8b-4f3f-9a04-6dfdef436237\") " pod="openshift-image-registry/node-ca-v68d2" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-run-k8s-cni-cncf-io\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012585 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ffefdb25-0ec3-4dda-9d05-df25861106dc-agent-certs\") pod \"konnectivity-agent-qlbwl\" (UID: \"ffefdb25-0ec3-4dda-9d05-df25861106dc\") " pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012604 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74dce66b-24ed-4967-a4a2-8b7710b45015-tmp-dir\") pod \"node-resolver-782f6\" (UID: \"74dce66b-24ed-4967-a4a2-8b7710b45015\") " pod="openshift-dns/node-resolver-782f6" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012620 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-sysconfig\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-cnibin\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012647 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-hostroot\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012658 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-sys-fs\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012688 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-etc-openvswitch\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012734 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-cni-bin\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.013865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012739 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-system-cni-dir\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012769 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-cni-netd\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012971 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-kubelet\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.012999 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-systemd-units\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.013276 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-ovnkube-script-lib\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.013335 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-etc-kubernetes\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.013370 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/397a08fc-3cf1-4f0b-aca2-d4b203a56fcf-host-slash\") pod \"iptables-alerter-j4qk5\" (UID: \"397a08fc-3cf1-4f0b-aca2-d4b203a56fcf\") " pod="openshift-network-operator/iptables-alerter-j4qk5" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.013394 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-ovn-node-metrics-cert\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.013403 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-var-lib-openvswitch\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.013405 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e93e7739-0a8b-4f3f-9a04-6dfdef436237-serviceca\") pod \"node-ca-v68d2\" (UID: \"e93e7739-0a8b-4f3f-9a04-6dfdef436237\") " pod="openshift-image-registry/node-ca-v68d2" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.013482 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-multus-socket-dir-parent\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.013530 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-run-netns\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.013572 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.013637 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-run-k8s-cni-cncf-io\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.014496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.013649 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-host-var-lib-cni-multus\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.016496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.016477 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ffefdb25-0ec3-4dda-9d05-df25861106dc-agent-certs\") pod \"konnectivity-agent-qlbwl\" (UID: \"ffefdb25-0ec3-4dda-9d05-df25861106dc\") " pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:09:57.017121 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.017098 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:09:57.017218 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.017127 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:09:57.017218 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.017140 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zvfcv for pod openshift-network-diagnostics/network-check-target-q9zg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:57.017218 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.017216 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv podName:68574744-4659-43b3-8b40-02421ad57599 nodeName:}" failed. No retries permitted until 2026-07-03 19:09:57.517186085 +0000 UTC m=+3.013485311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zvfcv" (UniqueName: "kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv") pod "network-check-target-q9zg2" (UID: "68574744-4659-43b3-8b40-02421ad57599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:57.018194 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.018115 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46f29\" (UniqueName: \"kubernetes.io/projected/e93e7739-0a8b-4f3f-9a04-6dfdef436237-kube-api-access-46f29\") pod \"node-ca-v68d2\" (UID: \"e93e7739-0a8b-4f3f-9a04-6dfdef436237\") " pod="openshift-image-registry/node-ca-v68d2" Jul 03 19:09:57.020196 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.020169 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v69x\" (UniqueName: \"kubernetes.io/projected/c4d12100-7327-46ca-98a8-c5de5bf1fdc3-kube-api-access-6v69x\") pod \"ovnkube-node-rvfrf\" (UID: \"c4d12100-7327-46ca-98a8-c5de5bf1fdc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.020598 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.020409 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shzbn\" (UniqueName: \"kubernetes.io/projected/f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1-kube-api-access-shzbn\") pod \"multus-hlfrb\" (UID: \"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1\") " pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.021179 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.020865 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmcvf\" (UniqueName: \"kubernetes.io/projected/397a08fc-3cf1-4f0b-aca2-d4b203a56fcf-kube-api-access-fmcvf\") pod \"iptables-alerter-j4qk5\" (UID: \"397a08fc-3cf1-4f0b-aca2-d4b203a56fcf\") " pod="openshift-network-operator/iptables-alerter-j4qk5" Jul 03 19:09:57.029210 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.029159 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-110.ec2.internal" event={"ID":"eeb56b029090ca0ee8dbd6a71a52c6ad","Type":"ContainerStarted","Data":"fd7701e0b617348a9a63038e63608a7b703fc27cc5e88bddfaa9430dbb5311e6"} Jul 03 19:09:57.030314 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.030291 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" event={"ID":"c86dee383fa021146df2b7324b62c96f","Type":"ContainerStarted","Data":"18026516ad6583996a5a9dc7f8b1a748b8fcc13254af31538ff0aab422547996"} Jul 03 19:09:57.113744 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.113691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-var-lib-kubelet\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.113912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.113754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2x4z\" (UniqueName: \"kubernetes.io/projected/e2c304af-54b0-4055-ad6f-36fe5e26f447-kube-api-access-k2x4z\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.113912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.113785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74dce66b-24ed-4967-a4a2-8b7710b45015-tmp-dir\") pod \"node-resolver-782f6\" (UID: \"74dce66b-24ed-4967-a4a2-8b7710b45015\") " pod="openshift-dns/node-resolver-782f6" Jul 03 19:09:57.113912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.113783 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-var-lib-kubelet\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.113912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.113810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-sysconfig\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.113912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.113880 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-sysconfig\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.114146 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-cnibin\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.114146 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-sys-fs\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.114146 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-systemd\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.114146 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114139 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-cnibin\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.114339 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114149 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.114339 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114177 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-sys-fs\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.114339 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e25bd906-a7c7-4493-ba18-b869f04781eb-tmp\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.114339 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114190 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74dce66b-24ed-4967-a4a2-8b7710b45015-tmp-dir\") pod \"node-resolver-782f6\" (UID: \"74dce66b-24ed-4967-a4a2-8b7710b45015\") " pod="openshift-dns/node-resolver-782f6" Jul 03 19:09:57.114339 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114216 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn85x\" (UniqueName: \"kubernetes.io/projected/e25bd906-a7c7-4493-ba18-b869f04781eb-kube-api-access-jn85x\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.114339 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:09:57.114339 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114251 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-systemd\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.114339 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114289 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:57.114339 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hxsn\" (UniqueName: \"kubernetes.io/projected/de0f9289-f59a-4261-8d85-80f74636a3b0-kube-api-access-2hxsn\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.114339 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114335 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-device-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.114353 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-system-cni-dir\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114387 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-device-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.114409 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs podName:f18c8179-6720-4e16-84aa-5c360dcf7a9a nodeName:}" failed. No retries permitted until 2026-07-03 19:09:57.614391273 +0000 UTC m=+3.110690511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs") pod "network-metrics-daemon-qjp6f" (UID: "f18c8179-6720-4e16-84aa-5c360dcf7a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114419 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-system-cni-dir\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.114478 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48da5a1e-f8a6-476c-b815-f0388f0ebb67-dbus\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-run\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.114525 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret podName:48da5a1e-f8a6-476c-b815-f0388f0ebb67 nodeName:}" failed. No retries permitted until 2026-07-03 19:09:57.614508314 +0000 UTC m=+3.110807535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret") pod "global-pull-secret-syncer-xhjjv" (UID: "48da5a1e-f8a6-476c-b815-f0388f0ebb67") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114550 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-sys\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114551 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-run\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114604 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-sys\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.114783 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114608 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-host\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114605 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48da5a1e-f8a6-476c-b815-f0388f0ebb67-dbus\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-host\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-socket-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-modprobe-d\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114711 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de0f9289-f59a-4261-8d85-80f74636a3b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74dce66b-24ed-4967-a4a2-8b7710b45015-hosts-file\") pod \"node-resolver-782f6\" (UID: \"74dce66b-24ed-4967-a4a2-8b7710b45015\") " pod="openshift-dns/node-resolver-782f6" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48da5a1e-f8a6-476c-b815-f0388f0ebb67-kubelet-config\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114820 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-socket-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114856 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74dce66b-24ed-4967-a4a2-8b7710b45015-hosts-file\") pod \"node-resolver-782f6\" (UID: \"74dce66b-24ed-4967-a4a2-8b7710b45015\") " pod="openshift-dns/node-resolver-782f6" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114876 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48da5a1e-f8a6-476c-b815-f0388f0ebb67-kubelet-config\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de0f9289-f59a-4261-8d85-80f74636a3b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scv27\" (UniqueName: \"kubernetes.io/projected/74dce66b-24ed-4967-a4a2-8b7710b45015-kube-api-access-scv27\") pod \"node-resolver-782f6\" (UID: \"74dce66b-24ed-4967-a4a2-8b7710b45015\") " pod="openshift-dns/node-resolver-782f6" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-sysctl-conf\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.115441 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-modprobe-d\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.114977 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-registration-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115004 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjrfr\" (UniqueName: \"kubernetes.io/projected/f18c8179-6720-4e16-84aa-5c360dcf7a9a-kube-api-access-wjrfr\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115039 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-lib-modules\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115062 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-os-release\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115083 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-etc-selinux\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-kubernetes\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115127 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-sysctl-d\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-tuned\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de0f9289-f59a-4261-8d85-80f74636a3b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115229 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de0f9289-f59a-4261-8d85-80f74636a3b0-os-release\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115299 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de0f9289-f59a-4261-8d85-80f74636a3b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115354 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-kubernetes\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.115959 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115365 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de0f9289-f59a-4261-8d85-80f74636a3b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.116478 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115395 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.116478 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115484 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-etc-selinux\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.116478 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115396 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-sysctl-conf\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.116478 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115504 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-sysctl-d\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.116478 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115555 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de0f9289-f59a-4261-8d85-80f74636a3b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.116478 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115562 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2c304af-54b0-4055-ad6f-36fe5e26f447-registration-dir\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.116478 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.115601 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e25bd906-a7c7-4493-ba18-b869f04781eb-lib-modules\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.116710 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.116588 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e25bd906-a7c7-4493-ba18-b869f04781eb-tmp\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.117615 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.117595 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e25bd906-a7c7-4493-ba18-b869f04781eb-etc-tuned\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.122905 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.122829 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn85x\" (UniqueName: \"kubernetes.io/projected/e25bd906-a7c7-4493-ba18-b869f04781eb-kube-api-access-jn85x\") pod \"tuned-s5d5p\" (UID: \"e25bd906-a7c7-4493-ba18-b869f04781eb\") " pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.122905 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.122889 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hxsn\" (UniqueName: \"kubernetes.io/projected/de0f9289-f59a-4261-8d85-80f74636a3b0-kube-api-access-2hxsn\") pod \"multus-additional-cni-plugins-krpln\" (UID: \"de0f9289-f59a-4261-8d85-80f74636a3b0\") " pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.123099 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.123074 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjrfr\" (UniqueName: \"kubernetes.io/projected/f18c8179-6720-4e16-84aa-5c360dcf7a9a-kube-api-access-wjrfr\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:09:57.123798 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.123767 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scv27\" (UniqueName: \"kubernetes.io/projected/74dce66b-24ed-4967-a4a2-8b7710b45015-kube-api-access-scv27\") pod \"node-resolver-782f6\" (UID: \"74dce66b-24ed-4967-a4a2-8b7710b45015\") " pod="openshift-dns/node-resolver-782f6" Jul 03 19:09:57.124147 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.124128 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2x4z\" (UniqueName: \"kubernetes.io/projected/e2c304af-54b0-4055-ad6f-36fe5e26f447-kube-api-access-k2x4z\") pod \"aws-ebs-csi-driver-node-dbt5d\" (UID: \"e2c304af-54b0-4055-ad6f-36fe5e26f447\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.192277 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.192238 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v68d2" Jul 03 19:09:57.202692 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.202665 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hlfrb" Jul 03 19:09:57.210100 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.210079 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j4qk5" Jul 03 19:09:57.214949 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.214929 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:09:57.222438 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.222416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:09:57.229853 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.229836 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-782f6" Jul 03 19:09:57.238011 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.237995 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-krpln" Jul 03 19:09:57.247516 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.247499 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" Jul 03 19:09:57.260078 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.260060 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" Jul 03 19:09:57.301087 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.301064 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:09:57.518378 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.518284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfcv\" (UniqueName: \"kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv\") pod \"network-check-target-q9zg2\" (UID: \"68574744-4659-43b3-8b40-02421ad57599\") " pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:09:57.518530 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.518419 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:09:57.518530 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.518434 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:09:57.518530 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.518442 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zvfcv for pod openshift-network-diagnostics/network-check-target-q9zg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:57.518530 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.518495 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv podName:68574744-4659-43b3-8b40-02421ad57599 nodeName:}" failed. No retries permitted until 2026-07-03 19:09:58.51847767 +0000 UTC m=+4.014776890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvfcv" (UniqueName: "kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv") pod "network-check-target-q9zg2" (UID: "68574744-4659-43b3-8b40-02421ad57599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:57.619315 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.619279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:09:57.619470 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.619328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:57.619470 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.619452 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:57.619565 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.619469 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:57.619565 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.619514 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret podName:48da5a1e-f8a6-476c-b815-f0388f0ebb67 nodeName:}" failed. No retries permitted until 2026-07-03 19:09:58.619494289 +0000 UTC m=+4.115793530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret") pod "global-pull-secret-syncer-xhjjv" (UID: "48da5a1e-f8a6-476c-b815-f0388f0ebb67") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:57.619565 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:57.619550 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs podName:f18c8179-6720-4e16-84aa-5c360dcf7a9a nodeName:}" failed. No retries permitted until 2026-07-03 19:09:58.619531581 +0000 UTC m=+4.115830804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs") pod "network-metrics-daemon-qjp6f" (UID: "f18c8179-6720-4e16-84aa-5c360dcf7a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:57.905564 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:57.905539 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397a08fc_3cf1_4f0b_aca2_d4b203a56fcf.slice/crio-746a54f3bcb406958e77228a1230aeeb8aa78bb0b70cafc09a9d0663fc3a8c29 WatchSource:0}: Error finding container 746a54f3bcb406958e77228a1230aeeb8aa78bb0b70cafc09a9d0663fc3a8c29: Status 404 returned error can't find the container with id 746a54f3bcb406958e77228a1230aeeb8aa78bb0b70cafc09a9d0663fc3a8c29 Jul 03 19:09:57.906949 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:57.906928 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93d73d5_d2c3_4bfb_80da_50c0cc1bb9d1.slice/crio-0cb89eb722fb9326e4b0d96fde246252d7f7ebf08efdad7edc03dba8dda56992 WatchSource:0}: Error finding container 0cb89eb722fb9326e4b0d96fde246252d7f7ebf08efdad7edc03dba8dda56992: Status 404 returned error can't find the container with id 0cb89eb722fb9326e4b0d96fde246252d7f7ebf08efdad7edc03dba8dda56992 Jul 03 19:09:57.909334 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:57.909309 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d12100_7327_46ca_98a8_c5de5bf1fdc3.slice/crio-111cce3079f8bd3cae04345398aa42899e9b0e66927b0ea2c219080c779f3c2d WatchSource:0}: Error finding container 111cce3079f8bd3cae04345398aa42899e9b0e66927b0ea2c219080c779f3c2d: Status 404 returned error can't find the container with id 111cce3079f8bd3cae04345398aa42899e9b0e66927b0ea2c219080c779f3c2d Jul 03 19:09:57.910477 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:57.910455 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde0f9289_f59a_4261_8d85_80f74636a3b0.slice/crio-a21d9c5dff318fd529e1070855905b8195c2450bdab14f540cfa5b801305c539 WatchSource:0}: Error finding container a21d9c5dff318fd529e1070855905b8195c2450bdab14f540cfa5b801305c539: Status 404 returned error can't find the container with id a21d9c5dff318fd529e1070855905b8195c2450bdab14f540cfa5b801305c539 Jul 03 19:09:57.932752 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:57.932669 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25bd906_a7c7_4493_ba18_b869f04781eb.slice/crio-9572245db81f883d190be4f71db2e5b7d421db3238621cdd2551791347a508ab WatchSource:0}: Error finding container 9572245db81f883d190be4f71db2e5b7d421db3238621cdd2551791347a508ab: Status 404 returned error can't find the container with id 9572245db81f883d190be4f71db2e5b7d421db3238621cdd2551791347a508ab Jul 03 19:09:57.934007 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:57.933978 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93e7739_0a8b_4f3f_9a04_6dfdef436237.slice/crio-8e2fd4274bdf22305590a100d1a3138a5f7f7b62aa5ff77b3b0598678c2263e7 WatchSource:0}: Error finding container 8e2fd4274bdf22305590a100d1a3138a5f7f7b62aa5ff77b3b0598678c2263e7: Status 404 returned error can't find the container with id 8e2fd4274bdf22305590a100d1a3138a5f7f7b62aa5ff77b3b0598678c2263e7 Jul 03 19:09:57.934862 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:57.934842 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c304af_54b0_4055_ad6f_36fe5e26f447.slice/crio-f4ce879c0474d19e5142f41cba0f3772d682b5c5b71041c2c35663bff6fa26bb WatchSource:0}: Error finding container f4ce879c0474d19e5142f41cba0f3772d682b5c5b71041c2c35663bff6fa26bb: Status 404 returned error can't find the container with id f4ce879c0474d19e5142f41cba0f3772d682b5c5b71041c2c35663bff6fa26bb Jul 03 19:09:57.935849 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:09:57.935726 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffefdb25_0ec3_4dda_9d05_df25861106dc.slice/crio-842377d5d4b50e98a673b7cad8d6987f87bad09293af623ca34f40397c060e60 WatchSource:0}: Error finding container 842377d5d4b50e98a673b7cad8d6987f87bad09293af623ca34f40397c060e60: Status 404 returned error can't find the container with id 842377d5d4b50e98a673b7cad8d6987f87bad09293af623ca34f40397c060e60 Jul 03 19:09:57.944950 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.944843 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 19:04:56 +0000 UTC" deadline="2028-04-12 18:44:56.59306939 +0000 UTC" Jul 03 19:09:57.944950 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:57.944899 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15575h34m58.648174187s" Jul 03 19:09:58.025197 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.025059 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:09:58.025584 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:58.025311 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:09:58.034446 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.034424 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" event={"ID":"e2c304af-54b0-4055-ad6f-36fe5e26f447","Type":"ContainerStarted","Data":"f4ce879c0474d19e5142f41cba0f3772d682b5c5b71041c2c35663bff6fa26bb"} Jul 03 19:09:58.035462 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.035436 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" event={"ID":"e25bd906-a7c7-4493-ba18-b869f04781eb","Type":"ContainerStarted","Data":"9572245db81f883d190be4f71db2e5b7d421db3238621cdd2551791347a508ab"} Jul 03 19:09:58.036443 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.036427 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v68d2" event={"ID":"e93e7739-0a8b-4f3f-9a04-6dfdef436237","Type":"ContainerStarted","Data":"8e2fd4274bdf22305590a100d1a3138a5f7f7b62aa5ff77b3b0598678c2263e7"} Jul 03 19:09:58.040526 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.040507 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-krpln" event={"ID":"de0f9289-f59a-4261-8d85-80f74636a3b0","Type":"ContainerStarted","Data":"a21d9c5dff318fd529e1070855905b8195c2450bdab14f540cfa5b801305c539"} Jul 03 19:09:58.044067 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.044042 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hlfrb" event={"ID":"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1","Type":"ContainerStarted","Data":"0cb89eb722fb9326e4b0d96fde246252d7f7ebf08efdad7edc03dba8dda56992"} Jul 03 19:09:58.047932 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.047913 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-110.ec2.internal" event={"ID":"eeb56b029090ca0ee8dbd6a71a52c6ad","Type":"ContainerStarted","Data":"316a2bfba41a9a80133d826822ae7b3887783ab145dc4409b1e03f01235c745a"} Jul 03 19:09:58.051521 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.051497 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-782f6" event={"ID":"74dce66b-24ed-4967-a4a2-8b7710b45015","Type":"ContainerStarted","Data":"de69539c7068a24b96f5d12640c05bfe0e8b99a2f9774e8628f77f1015c8c9ef"} Jul 03 19:09:58.052523 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.052506 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qlbwl" event={"ID":"ffefdb25-0ec3-4dda-9d05-df25861106dc","Type":"ContainerStarted","Data":"842377d5d4b50e98a673b7cad8d6987f87bad09293af623ca34f40397c060e60"} Jul 03 19:09:58.053669 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.053647 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" event={"ID":"c4d12100-7327-46ca-98a8-c5de5bf1fdc3","Type":"ContainerStarted","Data":"111cce3079f8bd3cae04345398aa42899e9b0e66927b0ea2c219080c779f3c2d"} Jul 03 19:09:58.054608 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.054590 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j4qk5" event={"ID":"397a08fc-3cf1-4f0b-aca2-d4b203a56fcf","Type":"ContainerStarted","Data":"746a54f3bcb406958e77228a1230aeeb8aa78bb0b70cafc09a9d0663fc3a8c29"} Jul 03 19:09:58.061006 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.060966 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-110.ec2.internal" podStartSLOduration=2.060955124 podStartE2EDuration="2.060955124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:09:58.060645456 +0000 UTC m=+3.556944695" watchObservedRunningTime="2026-07-03 19:09:58.060955124 +0000 UTC m=+3.557254364" Jul 03 19:09:58.527173 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.526692 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfcv\" (UniqueName: \"kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv\") pod \"network-check-target-q9zg2\" (UID: \"68574744-4659-43b3-8b40-02421ad57599\") " pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:09:58.527173 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:58.526889 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:09:58.527173 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:58.526912 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:09:58.527173 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:58.526925 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zvfcv for pod openshift-network-diagnostics/network-check-target-q9zg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:58.527173 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:58.526983 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv podName:68574744-4659-43b3-8b40-02421ad57599 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:00.526966589 +0000 UTC m=+6.023265824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvfcv" (UniqueName: "kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv") pod "network-check-target-q9zg2" (UID: "68574744-4659-43b3-8b40-02421ad57599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:58.628570 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.627868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:09:58.628570 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.627933 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:58.628570 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:58.628086 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:58.628570 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:58.628150 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret podName:48da5a1e-f8a6-476c-b815-f0388f0ebb67 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:00.628131802 +0000 UTC m=+6.124431022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret") pod "global-pull-secret-syncer-xhjjv" (UID: "48da5a1e-f8a6-476c-b815-f0388f0ebb67") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:58.628570 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:58.628211 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:58.628570 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:58.628241 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs podName:f18c8179-6720-4e16-84aa-5c360dcf7a9a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:00.628231213 +0000 UTC m=+6.124530438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs") pod "network-metrics-daemon-qjp6f" (UID: "f18c8179-6720-4e16-84aa-5c360dcf7a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:58.945157 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.945039 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 19:04:56 +0000 UTC" deadline="2028-02-06 22:10:12.109698743 +0000 UTC" Jul 03 19:09:58.945157 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:58.945102 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13995h0m13.164600901s" Jul 03 19:09:59.027724 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:59.027063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:09:59.027724 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:59.027196 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:09:59.027724 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:59.027585 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:09:59.027724 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:09:59.027673 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:09:59.065000 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:59.064019 2580 generic.go:356] "Generic (PLEG): container finished" podID="c86dee383fa021146df2b7324b62c96f" containerID="0b9704d79e36136c86d534343faabc0e05202fe863c09307dc186961a461635c" exitCode=0 Jul 03 19:09:59.065000 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:09:59.064947 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" event={"ID":"c86dee383fa021146df2b7324b62c96f","Type":"ContainerDied","Data":"0b9704d79e36136c86d534343faabc0e05202fe863c09307dc186961a461635c"} Jul 03 19:10:00.024869 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:00.024840 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:00.025045 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:00.024965 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:00.096195 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:00.096158 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" event={"ID":"c86dee383fa021146df2b7324b62c96f","Type":"ContainerStarted","Data":"8aadf9981d1c97907e6ef453b5ec8b1a0990242f0b970240e6923cbeff94065b"} Jul 03 19:10:00.548098 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:00.548059 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfcv\" (UniqueName: \"kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv\") pod \"network-check-target-q9zg2\" (UID: \"68574744-4659-43b3-8b40-02421ad57599\") " pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:00.548358 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:00.548282 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:00.548358 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:00.548307 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:00.548358 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:00.548319 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zvfcv for pod openshift-network-diagnostics/network-check-target-q9zg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:00.548529 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:00.548376 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv podName:68574744-4659-43b3-8b40-02421ad57599 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:04.548358975 +0000 UTC m=+10.044658198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvfcv" (UniqueName: "kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv") pod "network-check-target-q9zg2" (UID: "68574744-4659-43b3-8b40-02421ad57599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:00.649532 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:00.649497 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:00.649712 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:00.649549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:00.649712 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:00.649673 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:00.649828 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:00.649755 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret podName:48da5a1e-f8a6-476c-b815-f0388f0ebb67 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:04.649736028 +0000 UTC m=+10.146035260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret") pod "global-pull-secret-syncer-xhjjv" (UID: "48da5a1e-f8a6-476c-b815-f0388f0ebb67") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:00.650163 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:00.650122 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:00.650242 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:00.650174 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs podName:f18c8179-6720-4e16-84aa-5c360dcf7a9a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:04.650159077 +0000 UTC m=+10.146458300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs") pod "network-metrics-daemon-qjp6f" (UID: "f18c8179-6720-4e16-84aa-5c360dcf7a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:01.026025 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:01.025954 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:01.026165 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:01.025960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:01.026165 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:01.026107 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:01.026165 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:01.026153 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:02.025350 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:02.025319 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:02.025797 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:02.025425 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:03.025438 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:03.024872 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:03.025438 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:03.024872 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:03.025438 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:03.025040 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:03.025438 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:03.025127 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:04.025028 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:04.024998 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:04.025189 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:04.025105 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:04.581837 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:04.581797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfcv\" (UniqueName: \"kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv\") pod \"network-check-target-q9zg2\" (UID: \"68574744-4659-43b3-8b40-02421ad57599\") " pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:04.582210 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:04.582031 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:04.582210 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:04.582055 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:04.582210 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:04.582068 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zvfcv for pod openshift-network-diagnostics/network-check-target-q9zg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:04.582210 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:04.582126 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv podName:68574744-4659-43b3-8b40-02421ad57599 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:12.582108414 +0000 UTC m=+18.078407638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvfcv" (UniqueName: "kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv") pod "network-check-target-q9zg2" (UID: "68574744-4659-43b3-8b40-02421ad57599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:04.683100 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:04.683064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:04.683316 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:04.683116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:04.683316 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:04.683244 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:04.683475 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:04.683322 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret podName:48da5a1e-f8a6-476c-b815-f0388f0ebb67 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:12.68330199 +0000 UTC m=+18.179601229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret") pod "global-pull-secret-syncer-xhjjv" (UID: "48da5a1e-f8a6-476c-b815-f0388f0ebb67") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:04.683733 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:04.683707 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:04.683863 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:04.683761 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs podName:f18c8179-6720-4e16-84aa-5c360dcf7a9a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:12.683745522 +0000 UTC m=+18.180044752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs") pod "network-metrics-daemon-qjp6f" (UID: "f18c8179-6720-4e16-84aa-5c360dcf7a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:05.026052 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:05.025967 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:05.026202 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:05.026072 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:05.026514 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:05.026352 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:05.026514 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:05.026468 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:06.024984 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:06.024909 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:06.025448 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:06.025017 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:07.027848 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:07.027817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:07.028248 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:07.027832 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:07.028248 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:07.027932 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:07.028248 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:07.028050 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:08.024684 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:08.024653 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:08.024859 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:08.024791 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:09.027965 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:09.027932 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:09.028404 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:09.028053 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:09.028404 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:09.028106 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:09.028404 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:09.028206 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:10.024800 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:10.024764 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:10.024966 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:10.024886 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:11.024805 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:11.024725 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:11.024805 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:11.024772 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:11.025294 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:11.024871 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:11.025294 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:11.025001 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:12.025239 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:12.025212 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:12.025706 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:12.025343 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:12.641066 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:12.641037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfcv\" (UniqueName: \"kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv\") pod \"network-check-target-q9zg2\" (UID: \"68574744-4659-43b3-8b40-02421ad57599\") " pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:12.641245 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:12.641227 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:12.641245 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:12.641245 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:12.641378 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:12.641254 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zvfcv for pod openshift-network-diagnostics/network-check-target-q9zg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:12.641378 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:12.641329 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv podName:68574744-4659-43b3-8b40-02421ad57599 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:28.641311599 +0000 UTC m=+34.137610835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvfcv" (UniqueName: "kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv") pod "network-check-target-q9zg2" (UID: "68574744-4659-43b3-8b40-02421ad57599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:12.741545 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:12.741512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:12.741545 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:12.741550 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:12.741829 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:12.741679 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:12.741829 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:12.741686 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:12.741829 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:12.741737 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret podName:48da5a1e-f8a6-476c-b815-f0388f0ebb67 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:28.74171961 +0000 UTC m=+34.238018845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret") pod "global-pull-secret-syncer-xhjjv" (UID: "48da5a1e-f8a6-476c-b815-f0388f0ebb67") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:12.741829 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:12.741763 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs podName:f18c8179-6720-4e16-84aa-5c360dcf7a9a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:28.741746042 +0000 UTC m=+34.238045268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs") pod "network-metrics-daemon-qjp6f" (UID: "f18c8179-6720-4e16-84aa-5c360dcf7a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:13.025312 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:13.025212 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:13.025710 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:13.025223 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:13.025710 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:13.025377 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:13.025710 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:13.025464 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:14.024559 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:14.024528 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:14.024726 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:14.024647 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:15.025241 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:15.025208 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:15.025700 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:15.025331 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:15.025700 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:15.025384 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:15.025700 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:15.025503 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:16.025326 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:16.024890 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:16.025326 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:16.025004 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:16.128952 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:16.128915 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" event={"ID":"e25bd906-a7c7-4493-ba18-b869f04781eb","Type":"ContainerStarted","Data":"9ac246eea13a19295c5a89ed2b0e18ea486afe62b7ed8a23fad7854f0a95b36a"} Jul 03 19:10:16.148659 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:16.148605 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-110.ec2.internal" podStartSLOduration=20.148587362 podStartE2EDuration="20.148587362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:00.11196594 +0000 UTC m=+5.608265198" watchObservedRunningTime="2026-07-03 19:10:16.148587362 +0000 UTC m=+21.644886625" Jul 03 19:10:16.149109 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:16.148820 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s5d5p" podStartSLOduration=3.101555419 podStartE2EDuration="21.148811451s" totalImagesPullingTime="18.047256032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:16.148657247 +0000 UTC m=+21.644956487" watchObservedRunningTime="2026-07-03 19:10:16.148811451 +0000 UTC m=+21.645110692" Jul 03 19:10:17.024844 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.024668 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:17.024976 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.024668 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:17.024976 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:17.024954 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:17.025088 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:17.024980 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:17.132147 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.132112 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-782f6" event={"ID":"74dce66b-24ed-4967-a4a2-8b7710b45015","Type":"ContainerStarted","Data":"e0b7a58d1a6ca8a9674d06b633efff062d648a610d30907971220d56af5c17e8"} Jul 03 19:10:17.133460 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.133438 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qlbwl" event={"ID":"ffefdb25-0ec3-4dda-9d05-df25861106dc","Type":"ContainerStarted","Data":"3e50b85c4a8926b426ec63e6410e27cdb1dd65f167ec097c4eaa1b0b4925c5af"} Jul 03 19:10:17.136252 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.136230 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" event={"ID":"c4d12100-7327-46ca-98a8-c5de5bf1fdc3","Type":"ContainerStarted","Data":"a6ef86150b28130de22d18a77ab9588513d5e46e6e2af4d558bf4da50823e4b6"} Jul 03 19:10:17.136377 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.136296 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" event={"ID":"c4d12100-7327-46ca-98a8-c5de5bf1fdc3","Type":"ContainerStarted","Data":"3e28970c9765966c0228018b9754c945e43de7d6ad2f94d357f4dc91b87a8a7d"} Jul 03 19:10:17.136377 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.136345 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" event={"ID":"c4d12100-7327-46ca-98a8-c5de5bf1fdc3","Type":"ContainerStarted","Data":"23d75610a61c9c91039124decef2001f215e1ada98bd1aa95d2f98eeab90d405"} Jul 03 19:10:17.136460 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.136382 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" event={"ID":"c4d12100-7327-46ca-98a8-c5de5bf1fdc3","Type":"ContainerStarted","Data":"90627a750949272d421b0fe364555791b5b86c89ecec89a19943fac9d58aebfd"} Jul 03 19:10:17.136460 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.136411 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" event={"ID":"c4d12100-7327-46ca-98a8-c5de5bf1fdc3","Type":"ContainerStarted","Data":"956b7ad597bcd3d40780336f5809c921d0fa9c258b6ef3c3bc87fa95839b0e3c"} Jul 03 19:10:17.136460 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.136446 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" event={"ID":"c4d12100-7327-46ca-98a8-c5de5bf1fdc3","Type":"ContainerStarted","Data":"782c508d9bae2b71a731a06f32dcffdf0366d9b8a8f041fa27b8f77b440a26db"} Jul 03 19:10:17.137654 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.137636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" event={"ID":"e2c304af-54b0-4055-ad6f-36fe5e26f447","Type":"ContainerStarted","Data":"bc6ac60482ecdd3ab4af4923d3de0a8a204e300cd76a447940d50b54526a9f50"} Jul 03 19:10:17.138940 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.138921 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v68d2" event={"ID":"e93e7739-0a8b-4f3f-9a04-6dfdef436237","Type":"ContainerStarted","Data":"ed0ff17781318a12ee8e8a204442f3d00e66d86d250084a991561698ece2cf1a"} Jul 03 19:10:17.140289 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.140253 2580 generic.go:356] "Generic (PLEG): container finished" podID="de0f9289-f59a-4261-8d85-80f74636a3b0" containerID="b4cb8c0366b409c01c13519d9d1fcfda3de67f538be89e96dbf54e72c111a1f3" exitCode=0 Jul 03 19:10:17.140380 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.140354 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-krpln" event={"ID":"de0f9289-f59a-4261-8d85-80f74636a3b0","Type":"ContainerDied","Data":"b4cb8c0366b409c01c13519d9d1fcfda3de67f538be89e96dbf54e72c111a1f3"} Jul 03 19:10:17.141883 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.141864 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hlfrb" event={"ID":"f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1","Type":"ContainerStarted","Data":"682fd0a4598f41a7a068404c38a10590a642a5537d01531d1b7c27d8e8981c48"} Jul 03 19:10:17.145830 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.145788 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-782f6" podStartSLOduration=7.892696206 podStartE2EDuration="22.145772236s" totalImagesPullingTime="14.25307603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:17.145565798 +0000 UTC m=+22.641865055" watchObservedRunningTime="2026-07-03 19:10:17.145772236 +0000 UTC m=+22.642071479" Jul 03 19:10:17.161909 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.161869 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v68d2" podStartSLOduration=4.120627245 podStartE2EDuration="22.161856792s" totalImagesPullingTime="18.041229547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:17.161369359 +0000 UTC m=+22.657668599" watchObservedRunningTime="2026-07-03 19:10:17.161856792 +0000 UTC m=+22.658156032" Jul 03 19:10:17.174277 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.174224 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qlbwl" podStartSLOduration=7.921251565 podStartE2EDuration="22.17421324s" totalImagesPullingTime="14.252961675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:17.173656907 +0000 UTC m=+22.669956147" watchObservedRunningTime="2026-07-03 19:10:17.17421324 +0000 UTC m=+22.670512481" Jul 03 19:10:17.189436 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.189401 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hlfrb" podStartSLOduration=4.055934068 podStartE2EDuration="22.189388732s" totalImagesPullingTime="18.133454664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:17.189294199 +0000 UTC m=+22.685593460" watchObservedRunningTime="2026-07-03 19:10:17.189388732 +0000 UTC m=+22.685687979" Jul 03 19:10:17.408839 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.408809 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 03 19:10:17.965172 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.965037 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T19:10:17.408832759Z","UUID":"75eb5000-0607-4cbf-aad8-d2e01c5ffa14","Handler":null,"Name":"","Endpoint":""} Jul 03 19:10:17.966711 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.966683 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 03 19:10:17.966839 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:17.966728 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 03 19:10:18.024996 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:18.024968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:18.025171 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:18.025090 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:18.146060 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:18.146024 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" event={"ID":"e2c304af-54b0-4055-ad6f-36fe5e26f447","Type":"ContainerStarted","Data":"fe1a3cfb9fc0944d08b5d9508f72f2fe1f161eeb31b948188ed662282220f70e"} Jul 03 19:10:18.147461 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:18.147389 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j4qk5" event={"ID":"397a08fc-3cf1-4f0b-aca2-d4b203a56fcf","Type":"ContainerStarted","Data":"c669e876ba6d762679be86d4375e7a6e5587c8fb381cf83b21c558cee5154859"} Jul 03 19:10:18.162013 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:18.161962 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j4qk5" podStartSLOduration=5.091393685 podStartE2EDuration="23.161945972s" totalImagesPullingTime="18.070552287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:18.161805289 +0000 UTC m=+23.658104530" watchObservedRunningTime="2026-07-03 19:10:18.161945972 +0000 UTC m=+23.658245213" Jul 03 19:10:19.025078 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:19.025004 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:19.025239 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:19.025131 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:19.025479 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:19.025004 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:19.025588 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:19.025565 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:19.153350 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:19.153322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" event={"ID":"c4d12100-7327-46ca-98a8-c5de5bf1fdc3","Type":"ContainerStarted","Data":"64ce71bc979ec950ce51190327eadbd0b94c9d709928ec9304c2c4462bc19894"} Jul 03 19:10:20.024946 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:20.024751 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:20.025131 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:20.025040 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:20.157597 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:20.157555 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" event={"ID":"e2c304af-54b0-4055-ad6f-36fe5e26f447","Type":"ContainerStarted","Data":"64e8de3d61801d6108fde763e6ad0b460dc6d0a976eb051a4771db13076b9695"} Jul 03 19:10:20.174822 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:20.174771 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbt5d" podStartSLOduration=4.335633022 podStartE2EDuration="25.17475624s" totalImagesPullingTime="20.839123218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:20.1747347 +0000 UTC m=+25.671033942" watchObservedRunningTime="2026-07-03 19:10:20.17475624 +0000 UTC m=+25.671055479" Jul 03 19:10:21.025242 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:21.025209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:21.025408 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:21.025334 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:21.025408 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:21.025390 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:21.025532 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:21.025510 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:21.163651 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:21.163526 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" event={"ID":"c4d12100-7327-46ca-98a8-c5de5bf1fdc3","Type":"ContainerStarted","Data":"674e05c1181f2529acfed1543816a7e4aab53da6c19dac17b5f2e08dfc8e1ca2"} Jul 03 19:10:21.194625 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:21.194567 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" podStartSLOduration=8.078492058 podStartE2EDuration="26.194544367s" totalImagesPullingTime="18.116052309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:21.193857089 +0000 UTC m=+26.690156366" watchObservedRunningTime="2026-07-03 19:10:21.194544367 +0000 UTC m=+26.690843609" Jul 03 19:10:21.939900 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:21.939864 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:10:21.940431 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:21.940413 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:10:22.024945 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:22.024919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:22.025058 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:22.024999 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:22.166804 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:22.166775 2580 generic.go:356] "Generic (PLEG): container finished" podID="de0f9289-f59a-4261-8d85-80f74636a3b0" containerID="d9f2448f9c212b78b8d738122411ea11b3b1aba620b8d13b3adbde512c227433" exitCode=0 Jul 03 19:10:22.167450 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:22.166861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-krpln" event={"ID":"de0f9289-f59a-4261-8d85-80f74636a3b0","Type":"ContainerDied","Data":"d9f2448f9c212b78b8d738122411ea11b3b1aba620b8d13b3adbde512c227433"} Jul 03 19:10:22.171449 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:22.171131 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:10:22.171449 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:22.171181 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:10:22.171449 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:22.171277 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:10:22.171449 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:22.171354 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:10:22.171748 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:22.171563 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qlbwl" Jul 03 19:10:22.183205 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:22.183186 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:10:22.183445 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:22.183413 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:10:23.024838 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:23.024799 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:23.025076 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:23.024936 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:23.025076 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:23.024974 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:23.025076 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:23.025055 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:23.142899 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:23.142869 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q9zg2"] Jul 03 19:10:23.143044 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:23.143028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:23.143165 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:23.143140 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:23.143550 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:23.143531 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xhjjv"] Jul 03 19:10:23.148223 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:23.148201 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qjp6f"] Jul 03 19:10:23.169899 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:23.169873 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:23.170350 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:23.170010 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:23.170417 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:23.170356 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:23.170535 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:23.170507 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:24.174241 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:24.174213 2580 generic.go:356] "Generic (PLEG): container finished" podID="de0f9289-f59a-4261-8d85-80f74636a3b0" containerID="fa6d481919f7696e60127a349f0ab5b80aec12478f1f9365f0c5e824545c7e64" exitCode=0 Jul 03 19:10:24.174667 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:24.174305 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-krpln" event={"ID":"de0f9289-f59a-4261-8d85-80f74636a3b0","Type":"ContainerDied","Data":"fa6d481919f7696e60127a349f0ab5b80aec12478f1f9365f0c5e824545c7e64"} Jul 03 19:10:25.026661 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:25.026423 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:25.026815 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:25.026483 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:25.026815 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:25.026754 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:25.026815 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:25.026515 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:25.026941 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:25.026823 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:25.026941 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:25.026886 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:26.184287 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:26.184249 2580 generic.go:356] "Generic (PLEG): container finished" podID="de0f9289-f59a-4261-8d85-80f74636a3b0" containerID="9af592879a70603c4936f9392055712217823aa272fad0a784186e092cc166ad" exitCode=0 Jul 03 19:10:26.184789 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:26.184301 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-krpln" event={"ID":"de0f9289-f59a-4261-8d85-80f74636a3b0","Type":"ContainerDied","Data":"9af592879a70603c4936f9392055712217823aa272fad0a784186e092cc166ad"} Jul 03 19:10:27.025554 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:27.025522 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:27.025554 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:27.025560 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:27.025779 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:27.025522 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:27.025779 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:27.025654 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhjjv" podUID="48da5a1e-f8a6-476c-b815-f0388f0ebb67" Jul 03 19:10:27.025870 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:27.025811 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjp6f" podUID="f18c8179-6720-4e16-84aa-5c360dcf7a9a" Jul 03 19:10:27.025905 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:27.025888 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9zg2" podUID="68574744-4659-43b3-8b40-02421ad57599" Jul 03 19:10:28.661008 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.660971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfcv\" (UniqueName: \"kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv\") pod \"network-check-target-q9zg2\" (UID: \"68574744-4659-43b3-8b40-02421ad57599\") " pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:28.661619 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:28.661122 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:28.661619 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:28.661140 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:28.661619 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:28.661151 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zvfcv for pod openshift-network-diagnostics/network-check-target-q9zg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:28.661619 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:28.661214 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv podName:68574744-4659-43b3-8b40-02421ad57599 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:00.661196788 +0000 UTC m=+66.157496024 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvfcv" (UniqueName: "kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv") pod "network-check-target-q9zg2" (UID: "68574744-4659-43b3-8b40-02421ad57599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:28.762388 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.762309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:28.762388 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.762359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:28.762599 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:28.762478 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:28.762599 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:28.762506 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:28.762599 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:28.762552 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs podName:f18c8179-6720-4e16-84aa-5c360dcf7a9a nodeName:}" failed. No retries permitted until 2026-07-03 19:11:00.762533044 +0000 UTC m=+66.258832283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs") pod "network-metrics-daemon-qjp6f" (UID: "f18c8179-6720-4e16-84aa-5c360dcf7a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:28.762599 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:28.762571 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret podName:48da5a1e-f8a6-476c-b815-f0388f0ebb67 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:00.762561581 +0000 UTC m=+66.258860802 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret") pod "global-pull-secret-syncer-xhjjv" (UID: "48da5a1e-f8a6-476c-b815-f0388f0ebb67") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:28.775971 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.775945 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-110.ec2.internal" event="NodeReady" Jul 03 19:10:28.776087 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.776074 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 03 19:10:28.821647 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.821586 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dvkr6"] Jul 03 19:10:28.824372 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.824343 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x6tdp"] Jul 03 19:10:28.824502 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.824457 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:28.826402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.826383 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x6tdp" Jul 03 19:10:28.831041 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.827952 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 03 19:10:28.831041 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.828001 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 03 19:10:28.831041 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.828021 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8lvgc\"" Jul 03 19:10:28.831041 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.829546 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 03 19:10:28.831041 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.829766 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 03 19:10:28.831041 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.829921 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 03 19:10:28.831041 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.829975 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ghd46\"" Jul 03 19:10:28.833536 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.833515 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x6tdp"] Jul 03 19:10:28.836337 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.836247 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dvkr6"] Jul 03 19:10:28.963726 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.963691 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hch8v\" (UniqueName: \"kubernetes.io/projected/48a7b9f2-395c-41f2-8faa-25c05e793fb8-kube-api-access-hch8v\") pod \"ingress-canary-x6tdp\" (UID: \"48a7b9f2-395c-41f2-8faa-25c05e793fb8\") " pod="openshift-ingress-canary/ingress-canary-x6tdp" Jul 03 19:10:28.963912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.963734 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e009a38c-af47-4270-b2c1-c8e90de2fb8a-config-volume\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:28.963912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.963776 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:28.963912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.963797 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e009a38c-af47-4270-b2c1-c8e90de2fb8a-tmp-dir\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:28.963912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.963835 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bgd7\" (UniqueName: \"kubernetes.io/projected/e009a38c-af47-4270-b2c1-c8e90de2fb8a-kube-api-access-7bgd7\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:28.963912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:28.963864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48a7b9f2-395c-41f2-8faa-25c05e793fb8-cert\") pod \"ingress-canary-x6tdp\" (UID: \"48a7b9f2-395c-41f2-8faa-25c05e793fb8\") " pod="openshift-ingress-canary/ingress-canary-x6tdp" Jul 03 19:10:29.025198 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.025124 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:10:29.025351 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.025297 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:10:29.025483 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.025125 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:10:29.028018 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.027869 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 19:10:29.028018 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.027901 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwb25\"" Jul 03 19:10:29.028018 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.027901 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 19:10:29.028018 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.027918 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 19:10:29.028018 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.028012 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 19:10:29.028292 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.028166 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8gc2\"" Jul 03 19:10:29.065163 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.065144 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:29.065248 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.065173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e009a38c-af47-4270-b2c1-c8e90de2fb8a-tmp-dir\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:29.065248 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.065225 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bgd7\" (UniqueName: \"kubernetes.io/projected/e009a38c-af47-4270-b2c1-c8e90de2fb8a-kube-api-access-7bgd7\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:29.065371 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.065276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48a7b9f2-395c-41f2-8faa-25c05e793fb8-cert\") pod \"ingress-canary-x6tdp\" (UID: \"48a7b9f2-395c-41f2-8faa-25c05e793fb8\") " pod="openshift-ingress-canary/ingress-canary-x6tdp" Jul 03 19:10:29.065371 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:29.065316 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:29.065371 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.065340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hch8v\" (UniqueName: \"kubernetes.io/projected/48a7b9f2-395c-41f2-8faa-25c05e793fb8-kube-api-access-hch8v\") pod \"ingress-canary-x6tdp\" (UID: \"48a7b9f2-395c-41f2-8faa-25c05e793fb8\") " pod="openshift-ingress-canary/ingress-canary-x6tdp" Jul 03 19:10:29.065506 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:29.065374 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls podName:e009a38c-af47-4270-b2c1-c8e90de2fb8a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:29.565355911 +0000 UTC m=+35.061655146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls") pod "dns-default-dvkr6" (UID: "e009a38c-af47-4270-b2c1-c8e90de2fb8a") : secret "dns-default-metrics-tls" not found Jul 03 19:10:29.065506 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.065392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e009a38c-af47-4270-b2c1-c8e90de2fb8a-config-volume\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:29.065632 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.065516 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e009a38c-af47-4270-b2c1-c8e90de2fb8a-tmp-dir\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:29.065884 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.065863 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e009a38c-af47-4270-b2c1-c8e90de2fb8a-config-volume\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:29.069854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.069833 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48a7b9f2-395c-41f2-8faa-25c05e793fb8-cert\") pod \"ingress-canary-x6tdp\" (UID: \"48a7b9f2-395c-41f2-8faa-25c05e793fb8\") " pod="openshift-ingress-canary/ingress-canary-x6tdp" Jul 03 19:10:29.073578 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.073537 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bgd7\" (UniqueName: \"kubernetes.io/projected/e009a38c-af47-4270-b2c1-c8e90de2fb8a-kube-api-access-7bgd7\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:29.073677 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.073618 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hch8v\" (UniqueName: \"kubernetes.io/projected/48a7b9f2-395c-41f2-8faa-25c05e793fb8-kube-api-access-hch8v\") pod \"ingress-canary-x6tdp\" (UID: \"48a7b9f2-395c-41f2-8faa-25c05e793fb8\") " pod="openshift-ingress-canary/ingress-canary-x6tdp" Jul 03 19:10:29.146460 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.146431 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x6tdp" Jul 03 19:10:29.569552 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:29.569457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:29.569745 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:29.569624 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:29.569745 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:29.569693 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls podName:e009a38c-af47-4270-b2c1-c8e90de2fb8a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:30.569677384 +0000 UTC m=+36.065976623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls") pod "dns-default-dvkr6" (UID: "e009a38c-af47-4270-b2c1-c8e90de2fb8a") : secret "dns-default-metrics-tls" not found Jul 03 19:10:30.057991 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:30.057799 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x6tdp"] Jul 03 19:10:30.062562 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:10:30.062531 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a7b9f2_395c_41f2_8faa_25c05e793fb8.slice/crio-fbae2c1a1674382bd07ba553643f7d055ef2782843c908371da41aae62de636c WatchSource:0}: Error finding container fbae2c1a1674382bd07ba553643f7d055ef2782843c908371da41aae62de636c: Status 404 returned error can't find the container with id fbae2c1a1674382bd07ba553643f7d055ef2782843c908371da41aae62de636c Jul 03 19:10:30.194557 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:30.194462 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x6tdp" event={"ID":"48a7b9f2-395c-41f2-8faa-25c05e793fb8","Type":"ContainerStarted","Data":"fbae2c1a1674382bd07ba553643f7d055ef2782843c908371da41aae62de636c"} Jul 03 19:10:30.196903 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:30.196880 2580 generic.go:356] "Generic (PLEG): container finished" podID="de0f9289-f59a-4261-8d85-80f74636a3b0" containerID="ea159fe5a17ebe05028cce83bb4d1d1cfef6879470e683aa07453c15ee3c4779" exitCode=0 Jul 03 19:10:30.196989 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:30.196936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-krpln" event={"ID":"de0f9289-f59a-4261-8d85-80f74636a3b0","Type":"ContainerDied","Data":"ea159fe5a17ebe05028cce83bb4d1d1cfef6879470e683aa07453c15ee3c4779"} Jul 03 19:10:30.576292 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:30.576180 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:30.576433 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:30.576339 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:30.576433 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:30.576404 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls podName:e009a38c-af47-4270-b2c1-c8e90de2fb8a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:32.576389054 +0000 UTC m=+38.072688273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls") pod "dns-default-dvkr6" (UID: "e009a38c-af47-4270-b2c1-c8e90de2fb8a") : secret "dns-default-metrics-tls" not found Jul 03 19:10:31.202928 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:31.202890 2580 generic.go:356] "Generic (PLEG): container finished" podID="de0f9289-f59a-4261-8d85-80f74636a3b0" containerID="edcad12b1938b91cac958d0662d60a57d5fff4d3f0ad071978f62c0f5da489da" exitCode=0 Jul 03 19:10:31.203405 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:31.202950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-krpln" event={"ID":"de0f9289-f59a-4261-8d85-80f74636a3b0","Type":"ContainerDied","Data":"edcad12b1938b91cac958d0662d60a57d5fff4d3f0ad071978f62c0f5da489da"} Jul 03 19:10:32.209970 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:32.209785 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-krpln" event={"ID":"de0f9289-f59a-4261-8d85-80f74636a3b0","Type":"ContainerStarted","Data":"37f7dd00156743e5b5d70021be44b4cd836e52affcafcc3d499048614374ca9c"} Jul 03 19:10:32.233022 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:32.232479 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-krpln" podStartSLOduration=9.440961069 podStartE2EDuration="37.232459405s" totalImagesPullingTime="27.791498336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:32.231822124 +0000 UTC m=+37.728121366" watchObservedRunningTime="2026-07-03 19:10:32.232459405 +0000 UTC m=+37.728758624" Jul 03 19:10:32.592020 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:32.591948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:32.592151 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:32.592057 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:32.592151 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:32.592107 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls podName:e009a38c-af47-4270-b2c1-c8e90de2fb8a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:36.592094443 +0000 UTC m=+42.088393662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls") pod "dns-default-dvkr6" (UID: "e009a38c-af47-4270-b2c1-c8e90de2fb8a") : secret "dns-default-metrics-tls" not found Jul 03 19:10:33.213207 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:33.213134 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x6tdp" event={"ID":"48a7b9f2-395c-41f2-8faa-25c05e793fb8","Type":"ContainerStarted","Data":"e39b44ef36adf423500b456da7ffa17c29945dbee8b5380a738b4f87024d516f"} Jul 03 19:10:33.227049 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:33.227008 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x6tdp" podStartSLOduration=2.357716748 podStartE2EDuration="5.226994553s" totalImagesPullingTime="2.869277805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:33.226419797 +0000 UTC m=+38.722719069" watchObservedRunningTime="2026-07-03 19:10:33.226994553 +0000 UTC m=+38.723293793" Jul 03 19:10:36.619886 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:36.619853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:36.620314 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:36.619994 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:36.620314 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:36.620058 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls podName:e009a38c-af47-4270-b2c1-c8e90de2fb8a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:44.62004344 +0000 UTC m=+50.116342660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls") pod "dns-default-dvkr6" (UID: "e009a38c-af47-4270-b2c1-c8e90de2fb8a") : secret "dns-default-metrics-tls" not found Jul 03 19:10:44.675369 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:44.675330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:10:44.675807 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:44.675483 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:44.675807 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:10:44.675543 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls podName:e009a38c-af47-4270-b2c1-c8e90de2fb8a nodeName:}" failed. No retries permitted until 2026-07-03 19:11:00.675528932 +0000 UTC m=+66.171828151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls") pod "dns-default-dvkr6" (UID: "e009a38c-af47-4270-b2c1-c8e90de2fb8a") : secret "dns-default-metrics-tls" not found Jul 03 19:10:54.191115 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:10:54.191086 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvfrf" Jul 03 19:11:00.676436 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.676391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:11:00.676436 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.676439 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfcv\" (UniqueName: \"kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv\") pod \"network-check-target-q9zg2\" (UID: \"68574744-4659-43b3-8b40-02421ad57599\") " pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:11:00.676960 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:00.676538 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:11:00.676960 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:00.676619 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls podName:e009a38c-af47-4270-b2c1-c8e90de2fb8a nodeName:}" failed. No retries permitted until 2026-07-03 19:11:32.676602521 +0000 UTC m=+98.172901741 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls") pod "dns-default-dvkr6" (UID: "e009a38c-af47-4270-b2c1-c8e90de2fb8a") : secret "dns-default-metrics-tls" not found Jul 03 19:11:00.679300 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.679285 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 19:11:00.688587 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.688568 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 19:11:00.701081 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.701060 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvfcv\" (UniqueName: \"kubernetes.io/projected/68574744-4659-43b3-8b40-02421ad57599-kube-api-access-zvfcv\") pod \"network-check-target-q9zg2\" (UID: \"68574744-4659-43b3-8b40-02421ad57599\") " pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:11:00.777016 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.776993 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:11:00.777125 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.777019 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:11:00.779221 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.779196 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 19:11:00.779397 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.779381 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 19:11:00.788135 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:00.788118 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 03 19:11:00.788188 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:00.788179 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs podName:f18c8179-6720-4e16-84aa-5c360dcf7a9a nodeName:}" failed. No retries permitted until 2026-07-03 19:12:04.788162535 +0000 UTC m=+130.284461755 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs") pod "network-metrics-daemon-qjp6f" (UID: "f18c8179-6720-4e16-84aa-5c360dcf7a9a") : secret "metrics-daemon-secret" not found Jul 03 19:11:00.790004 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.789980 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48da5a1e-f8a6-476c-b815-f0388f0ebb67-original-pull-secret\") pod \"global-pull-secret-syncer-xhjjv\" (UID: \"48da5a1e-f8a6-476c-b815-f0388f0ebb67\") " pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:11:00.842314 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.842257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhjjv" Jul 03 19:11:00.850246 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.850223 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8gc2\"" Jul 03 19:11:00.858997 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.858978 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:11:00.986683 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.986653 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xhjjv"] Jul 03 19:11:00.990190 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:00.990166 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48da5a1e_f8a6_476c_b815_f0388f0ebb67.slice/crio-4ac9e70580cf1e7226b522a495016c3298aea2ae1cc5f0a5d703f45963e38fb9 WatchSource:0}: Error finding container 4ac9e70580cf1e7226b522a495016c3298aea2ae1cc5f0a5d703f45963e38fb9: Status 404 returned error can't find the container with id 4ac9e70580cf1e7226b522a495016c3298aea2ae1cc5f0a5d703f45963e38fb9 Jul 03 19:11:00.998723 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:00.998697 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q9zg2"] Jul 03 19:11:01.003073 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:01.003047 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68574744_4659_43b3_8b40_02421ad57599.slice/crio-b572d9afac9835c467fcaeeaa170689d98079e0d1f75393115a7f7799cc49fd7 WatchSource:0}: Error finding container b572d9afac9835c467fcaeeaa170689d98079e0d1f75393115a7f7799cc49fd7: Status 404 returned error can't find the container with id b572d9afac9835c467fcaeeaa170689d98079e0d1f75393115a7f7799cc49fd7 Jul 03 19:11:01.272311 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:01.272206 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q9zg2" event={"ID":"68574744-4659-43b3-8b40-02421ad57599","Type":"ContainerStarted","Data":"b572d9afac9835c467fcaeeaa170689d98079e0d1f75393115a7f7799cc49fd7"} Jul 03 19:11:01.273909 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:01.273836 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xhjjv" event={"ID":"48da5a1e-f8a6-476c-b815-f0388f0ebb67","Type":"ContainerStarted","Data":"4ac9e70580cf1e7226b522a495016c3298aea2ae1cc5f0a5d703f45963e38fb9"} Jul 03 19:11:05.538356 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.537997 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp"] Jul 03 19:11:05.540176 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.540156 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:05.542540 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.542500 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 03 19:11:05.542657 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.542558 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:11:05.543460 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.543443 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 03 19:11:05.543568 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.543508 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h2brq\"" Jul 03 19:11:05.548783 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.548763 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp"] Jul 03 19:11:05.611654 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.611621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfg5q\" (UniqueName: \"kubernetes.io/projected/3963c691-f812-46a6-8981-e7c299e5d697-kube-api-access-qfg5q\") pod \"cluster-samples-operator-56fcf86bf-x2cpp\" (UID: \"3963c691-f812-46a6-8981-e7c299e5d697\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:05.611837 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.611692 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-x2cpp\" (UID: \"3963c691-f812-46a6-8981-e7c299e5d697\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:05.635454 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.635419 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-4zbpv"] Jul 03 19:11:05.637749 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.637730 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.639802 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.639783 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 03 19:11:05.639910 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.639889 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xt4kh\"" Jul 03 19:11:05.639967 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.639924 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 03 19:11:05.640043 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.640023 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 03 19:11:05.640087 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.640034 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 03 19:11:05.645098 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.645079 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 03 19:11:05.648680 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.648660 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-4zbpv"] Jul 03 19:11:05.712482 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.712450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a976ac92-4645-440d-af46-c5d9b51aa551-serving-cert\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.712664 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.712500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-x2cpp\" (UID: \"3963c691-f812-46a6-8981-e7c299e5d697\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:05.712664 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.712530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a976ac92-4645-440d-af46-c5d9b51aa551-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.712664 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.712555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fxpf\" (UniqueName: \"kubernetes.io/projected/a976ac92-4645-440d-af46-c5d9b51aa551-kube-api-access-7fxpf\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.712664 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.712600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a976ac92-4645-440d-af46-c5d9b51aa551-snapshots\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.712664 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:05.712625 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 19:11:05.712664 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.712630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a976ac92-4645-440d-af46-c5d9b51aa551-tmp\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.712969 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:05.712702 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls podName:3963c691-f812-46a6-8981-e7c299e5d697 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:06.21268098 +0000 UTC m=+71.708980203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-x2cpp" (UID: "3963c691-f812-46a6-8981-e7c299e5d697") : secret "samples-operator-tls" not found Jul 03 19:11:05.712969 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.712758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfg5q\" (UniqueName: \"kubernetes.io/projected/3963c691-f812-46a6-8981-e7c299e5d697-kube-api-access-qfg5q\") pod \"cluster-samples-operator-56fcf86bf-x2cpp\" (UID: \"3963c691-f812-46a6-8981-e7c299e5d697\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:05.712969 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.712796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a976ac92-4645-440d-af46-c5d9b51aa551-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.726061 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.726036 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfg5q\" (UniqueName: \"kubernetes.io/projected/3963c691-f812-46a6-8981-e7c299e5d697-kube-api-access-qfg5q\") pod \"cluster-samples-operator-56fcf86bf-x2cpp\" (UID: \"3963c691-f812-46a6-8981-e7c299e5d697\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:05.734516 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.734494 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-frngt"] Jul 03 19:11:05.736386 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.736370 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-frngt" Jul 03 19:11:05.738495 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.738474 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:11:05.738593 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.738543 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 03 19:11:05.738712 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.738696 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5jxcn\"" Jul 03 19:11:05.748627 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.748606 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-frngt"] Jul 03 19:11:05.755568 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.755548 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-b8b6fffc9-ks2dx"] Jul 03 19:11:05.757240 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.757223 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nthgs"] Jul 03 19:11:05.757375 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.757360 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.761586 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.761564 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.761697 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.761675 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 03 19:11:05.761761 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.761743 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 03 19:11:05.761761 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.761756 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 03 19:11:05.761866 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.761743 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 03 19:11:05.761866 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.761800 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t7lqg\"" Jul 03 19:11:05.761955 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.761911 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 03 19:11:05.762005 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.761951 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 03 19:11:05.763750 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.763728 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 03 19:11:05.763995 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.763983 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6kfjb\"" Jul 03 19:11:05.764156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.764144 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 03 19:11:05.764277 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.764250 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 03 19:11:05.764436 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.764417 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:11:05.769392 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.769372 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nthgs"] Jul 03 19:11:05.771276 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.771226 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 03 19:11:05.773352 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.773333 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b8b6fffc9-ks2dx"] Jul 03 19:11:05.813972 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.813947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a976ac92-4645-440d-af46-c5d9b51aa551-serving-cert\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.814081 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.813993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6929e3c8-865f-456c-8d1e-061a213fad05-trusted-ca\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.814081 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814012 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.814081 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6929e3c8-865f-456c-8d1e-061a213fad05-config\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.814081 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814073 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqcbf\" (UniqueName: \"kubernetes.io/projected/6929e3c8-865f-456c-8d1e-061a213fad05-kube-api-access-mqcbf\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.814252 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a976ac92-4645-440d-af46-c5d9b51aa551-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.814252 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fxpf\" (UniqueName: \"kubernetes.io/projected/a976ac92-4645-440d-af46-c5d9b51aa551-kube-api-access-7fxpf\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.814252 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.814252 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814187 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcnbn\" (UniqueName: \"kubernetes.io/projected/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-kube-api-access-wcnbn\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.814252 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a976ac92-4645-440d-af46-c5d9b51aa551-snapshots\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.814496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a976ac92-4645-440d-af46-c5d9b51aa551-tmp\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.814496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814302 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlhxv\" (UniqueName: \"kubernetes.io/projected/382064e7-ae0a-4846-af74-ee367b8b371c-kube-api-access-qlhxv\") pod \"volume-data-source-validator-5d456fdbcd-frngt\" (UID: \"382064e7-ae0a-4846-af74-ee367b8b371c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-frngt" Jul 03 19:11:05.814496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814326 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6929e3c8-865f-456c-8d1e-061a213fad05-serving-cert\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.814496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-default-certificate\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.814496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-stats-auth\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.814496 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814439 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a976ac92-4645-440d-af46-c5d9b51aa551-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.814676 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814554 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a976ac92-4645-440d-af46-c5d9b51aa551-tmp\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.814801 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814785 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a976ac92-4645-440d-af46-c5d9b51aa551-snapshots\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.814834 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814804 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a976ac92-4645-440d-af46-c5d9b51aa551-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.814986 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.814968 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a976ac92-4645-440d-af46-c5d9b51aa551-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.816358 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.816340 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a976ac92-4645-440d-af46-c5d9b51aa551-serving-cert\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.821122 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.821098 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fxpf\" (UniqueName: \"kubernetes.io/projected/a976ac92-4645-440d-af46-c5d9b51aa551-kube-api-access-7fxpf\") pod \"insights-operator-5c847dcfc4-4zbpv\" (UID: \"a976ac92-4645-440d-af46-c5d9b51aa551\") " pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:05.915106 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6929e3c8-865f-456c-8d1e-061a213fad05-trusted-ca\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.915251 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.915251 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6929e3c8-865f-456c-8d1e-061a213fad05-config\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.915251 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqcbf\" (UniqueName: \"kubernetes.io/projected/6929e3c8-865f-456c-8d1e-061a213fad05-kube-api-access-mqcbf\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.915251 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.915494 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnbn\" (UniqueName: \"kubernetes.io/projected/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-kube-api-access-wcnbn\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.915494 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:05.915317 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 19:11:05.915494 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:05.915337 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle podName:07a6fca2-14ed-4971-aa93-2f928fbfcf7c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:06.415315587 +0000 UTC m=+71.911614810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle") pod "router-default-b8b6fffc9-ks2dx" (UID: "07a6fca2-14ed-4971-aa93-2f928fbfcf7c") : configmap references non-existent config key: service-ca.crt Jul 03 19:11:05.915494 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:05.915399 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs podName:07a6fca2-14ed-4971-aa93-2f928fbfcf7c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:06.415380031 +0000 UTC m=+71.911679251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs") pod "router-default-b8b6fffc9-ks2dx" (UID: "07a6fca2-14ed-4971-aa93-2f928fbfcf7c") : secret "router-metrics-certs-default" not found Jul 03 19:11:05.915494 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlhxv\" (UniqueName: \"kubernetes.io/projected/382064e7-ae0a-4846-af74-ee367b8b371c-kube-api-access-qlhxv\") pod \"volume-data-source-validator-5d456fdbcd-frngt\" (UID: \"382064e7-ae0a-4846-af74-ee367b8b371c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-frngt" Jul 03 19:11:05.915494 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915450 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6929e3c8-865f-456c-8d1e-061a213fad05-serving-cert\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.915494 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-default-certificate\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.915818 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-stats-auth\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.915818 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915762 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6929e3c8-865f-456c-8d1e-061a213fad05-config\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.915985 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.915965 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6929e3c8-865f-456c-8d1e-061a213fad05-trusted-ca\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.917609 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.917588 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6929e3c8-865f-456c-8d1e-061a213fad05-serving-cert\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.917698 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.917631 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-default-certificate\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.917698 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.917686 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-stats-auth\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.924853 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.924815 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqcbf\" (UniqueName: \"kubernetes.io/projected/6929e3c8-865f-456c-8d1e-061a213fad05-kube-api-access-mqcbf\") pod \"console-operator-68b757fb67-nthgs\" (UID: \"6929e3c8-865f-456c-8d1e-061a213fad05\") " pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:05.925015 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.924999 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlhxv\" (UniqueName: \"kubernetes.io/projected/382064e7-ae0a-4846-af74-ee367b8b371c-kube-api-access-qlhxv\") pod \"volume-data-source-validator-5d456fdbcd-frngt\" (UID: \"382064e7-ae0a-4846-af74-ee367b8b371c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-frngt" Jul 03 19:11:05.925062 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.925052 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcnbn\" (UniqueName: \"kubernetes.io/projected/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-kube-api-access-wcnbn\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:05.947305 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:05.947287 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" Jul 03 19:11:06.044761 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.044733 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-frngt" Jul 03 19:11:06.060962 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.060939 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-4zbpv"] Jul 03 19:11:06.063685 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:06.063653 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda976ac92_4645_440d_af46_c5d9b51aa551.slice/crio-f8bfe84340503547db24b6034f1a72ef6323d6dc874b909e2355f6785ecbaddd WatchSource:0}: Error finding container f8bfe84340503547db24b6034f1a72ef6323d6dc874b909e2355f6785ecbaddd: Status 404 returned error can't find the container with id f8bfe84340503547db24b6034f1a72ef6323d6dc874b909e2355f6785ecbaddd Jul 03 19:11:06.077774 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.077756 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:06.178769 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.178740 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-frngt"] Jul 03 19:11:06.182339 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:06.182314 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382064e7_ae0a_4846_af74_ee367b8b371c.slice/crio-dfe37bcb0c08833d2472b5ec3bcebc37d391838509201dbf780a8113bc5a556b WatchSource:0}: Error finding container dfe37bcb0c08833d2472b5ec3bcebc37d391838509201dbf780a8113bc5a556b: Status 404 returned error can't find the container with id dfe37bcb0c08833d2472b5ec3bcebc37d391838509201dbf780a8113bc5a556b Jul 03 19:11:06.194164 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.194140 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nthgs"] Jul 03 19:11:06.196543 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:06.196519 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6929e3c8_865f_456c_8d1e_061a213fad05.slice/crio-6957656da95ad73a5f846b921a6a3fdb76b31e51a7488be4aa9d0dfa1738e25a WatchSource:0}: Error finding container 6957656da95ad73a5f846b921a6a3fdb76b31e51a7488be4aa9d0dfa1738e25a: Status 404 returned error can't find the container with id 6957656da95ad73a5f846b921a6a3fdb76b31e51a7488be4aa9d0dfa1738e25a Jul 03 19:11:06.218009 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.217989 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-x2cpp\" (UID: \"3963c691-f812-46a6-8981-e7c299e5d697\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:06.218154 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:06.218138 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 19:11:06.218219 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:06.218201 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls podName:3963c691-f812-46a6-8981-e7c299e5d697 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:07.218182467 +0000 UTC m=+72.714481702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-x2cpp" (UID: "3963c691-f812-46a6-8981-e7c299e5d697") : secret "samples-operator-tls" not found Jul 03 19:11:06.288937 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.288885 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" event={"ID":"6929e3c8-865f-456c-8d1e-061a213fad05","Type":"ContainerStarted","Data":"6957656da95ad73a5f846b921a6a3fdb76b31e51a7488be4aa9d0dfa1738e25a"} Jul 03 19:11:06.290000 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.289976 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" event={"ID":"a976ac92-4645-440d-af46-c5d9b51aa551","Type":"ContainerStarted","Data":"f8bfe84340503547db24b6034f1a72ef6323d6dc874b909e2355f6785ecbaddd"} Jul 03 19:11:06.291337 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.291316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xhjjv" event={"ID":"48da5a1e-f8a6-476c-b815-f0388f0ebb67","Type":"ContainerStarted","Data":"1a29dc02085f522e09d71126488fb98ae2346d64a8fa5a7b3f87ccd2f46eafe0"} Jul 03 19:11:06.292712 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.292689 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q9zg2" event={"ID":"68574744-4659-43b3-8b40-02421ad57599","Type":"ContainerStarted","Data":"9f794372c0905e92ebf68e93256d5204fcce53ee74b181371a8ae378a097922f"} Jul 03 19:11:06.292793 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.292746 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:11:06.293743 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.293725 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-frngt" event={"ID":"382064e7-ae0a-4846-af74-ee367b8b371c","Type":"ContainerStarted","Data":"dfe37bcb0c08833d2472b5ec3bcebc37d391838509201dbf780a8113bc5a556b"} Jul 03 19:11:06.306110 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.306068 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xhjjv" podStartSLOduration=66.893007627 podStartE2EDuration="1m11.306055648s" totalImagesPullingTime="4.413048021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:06.305498402 +0000 UTC m=+71.801797663" watchObservedRunningTime="2026-07-03 19:11:06.306055648 +0000 UTC m=+71.802354889" Jul 03 19:11:06.419353 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.419317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:06.419524 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:06.419478 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 19:11:06.419524 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:06.419492 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:06.419630 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:06.419547 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs podName:07a6fca2-14ed-4971-aa93-2f928fbfcf7c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:07.419528281 +0000 UTC m=+72.915827518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs") pod "router-default-b8b6fffc9-ks2dx" (UID: "07a6fca2-14ed-4971-aa93-2f928fbfcf7c") : secret "router-metrics-certs-default" not found Jul 03 19:11:06.419630 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:06.419595 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle podName:07a6fca2-14ed-4971-aa93-2f928fbfcf7c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:07.419585082 +0000 UTC m=+72.915884310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle") pod "router-default-b8b6fffc9-ks2dx" (UID: "07a6fca2-14ed-4971-aa93-2f928fbfcf7c") : configmap references non-existent config key: service-ca.crt Jul 03 19:11:07.227171 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:07.227131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-x2cpp\" (UID: \"3963c691-f812-46a6-8981-e7c299e5d697\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:07.227678 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:07.227326 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 19:11:07.227678 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:07.227423 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls podName:3963c691-f812-46a6-8981-e7c299e5d697 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:09.227402684 +0000 UTC m=+74.723701902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-x2cpp" (UID: "3963c691-f812-46a6-8981-e7c299e5d697") : secret "samples-operator-tls" not found Jul 03 19:11:07.428857 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:07.428816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:07.429032 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:07.428893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:07.429032 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:07.428995 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 19:11:07.429133 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:07.429050 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle podName:07a6fca2-14ed-4971-aa93-2f928fbfcf7c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:09.42902176 +0000 UTC m=+74.925320985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle") pod "router-default-b8b6fffc9-ks2dx" (UID: "07a6fca2-14ed-4971-aa93-2f928fbfcf7c") : configmap references non-existent config key: service-ca.crt Jul 03 19:11:07.429133 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:07.429079 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs podName:07a6fca2-14ed-4971-aa93-2f928fbfcf7c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:09.429068769 +0000 UTC m=+74.925367991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs") pod "router-default-b8b6fffc9-ks2dx" (UID: "07a6fca2-14ed-4971-aa93-2f928fbfcf7c") : secret "router-metrics-certs-default" not found Jul 03 19:11:08.302140 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:08.302102 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-frngt" event={"ID":"382064e7-ae0a-4846-af74-ee367b8b371c","Type":"ContainerStarted","Data":"aac5b1bc5aa09fc2e2050bc82f058cd81ccbb72d37faff54d30854e0a3348b4a"} Jul 03 19:11:08.317289 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:08.316745 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-frngt" podStartSLOduration=2.161256349 podStartE2EDuration="3.316727266s" totalImagesPullingTime="1.155470917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:08.316561299 +0000 UTC m=+73.812860745" watchObservedRunningTime="2026-07-03 19:11:08.316727266 +0000 UTC m=+73.813026510" Jul 03 19:11:08.317487 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:08.317454 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q9zg2" podStartSLOduration=68.920999518 podStartE2EDuration="1m13.317443128s" totalImagesPullingTime="4.39644361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:06.318172767 +0000 UTC m=+71.814472008" watchObservedRunningTime="2026-07-03 19:11:08.317443128 +0000 UTC m=+73.813742397" Jul 03 19:11:09.242513 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:09.242476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-x2cpp\" (UID: \"3963c691-f812-46a6-8981-e7c299e5d697\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:09.242677 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:09.242625 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 19:11:09.242717 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:09.242689 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls podName:3963c691-f812-46a6-8981-e7c299e5d697 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:13.242671986 +0000 UTC m=+78.738971221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-x2cpp" (UID: "3963c691-f812-46a6-8981-e7c299e5d697") : secret "samples-operator-tls" not found Jul 03 19:11:09.309973 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:09.309945 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/0.log" Jul 03 19:11:09.310388 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:09.309994 2580 generic.go:356] "Generic (PLEG): container finished" podID="6929e3c8-865f-456c-8d1e-061a213fad05" containerID="65e58827983ac433b00ed444be69e369dbe602b67f1cb1c5004d78647364aab2" exitCode=255 Jul 03 19:11:09.310388 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:09.310080 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" event={"ID":"6929e3c8-865f-456c-8d1e-061a213fad05","Type":"ContainerDied","Data":"65e58827983ac433b00ed444be69e369dbe602b67f1cb1c5004d78647364aab2"} Jul 03 19:11:09.310388 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:09.310312 2580 scope.go:117] "RemoveContainer" containerID="65e58827983ac433b00ed444be69e369dbe602b67f1cb1c5004d78647364aab2" Jul 03 19:11:09.311700 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:09.311677 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" event={"ID":"a976ac92-4645-440d-af46-c5d9b51aa551","Type":"ContainerStarted","Data":"2a34827f6675bff725ec0cc4f91be1b88a2d448f4c476816fc2c9f9f9fb5b078"} Jul 03 19:11:09.340289 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:09.340230 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" podStartSLOduration=1.794427285 podStartE2EDuration="4.340211304s" totalImagesPullingTime="2.545784019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:09.339006772 +0000 UTC m=+74.835306013" watchObservedRunningTime="2026-07-03 19:11:09.340211304 +0000 UTC m=+74.836510546" Jul 03 19:11:09.445156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:09.445120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:09.445327 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:09.445187 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:09.445327 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:09.445305 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle podName:07a6fca2-14ed-4971-aa93-2f928fbfcf7c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:13.445289036 +0000 UTC m=+78.941588263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle") pod "router-default-b8b6fffc9-ks2dx" (UID: "07a6fca2-14ed-4971-aa93-2f928fbfcf7c") : configmap references non-existent config key: service-ca.crt Jul 03 19:11:09.445327 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:09.445311 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 19:11:09.445454 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:09.445364 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs podName:07a6fca2-14ed-4971-aa93-2f928fbfcf7c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:13.445349352 +0000 UTC m=+78.941648571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs") pod "router-default-b8b6fffc9-ks2dx" (UID: "07a6fca2-14ed-4971-aa93-2f928fbfcf7c") : secret "router-metrics-certs-default" not found Jul 03 19:11:10.067885 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.067843 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vnd8r"] Jul 03 19:11:10.070307 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.070283 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.072600 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.072576 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 03 19:11:10.072703 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.072616 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 03 19:11:10.072703 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.072627 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lkngf\"" Jul 03 19:11:10.081218 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.081198 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vnd8r"] Jul 03 19:11:10.149905 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.149874 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.150062 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.149978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c707a275-3290-4ec7-973a-a8b5629b99f7-crio-socket\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.150062 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.150006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.150062 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.150032 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c707a275-3290-4ec7-973a-a8b5629b99f7-data-volume\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.150183 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.150155 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xw29\" (UniqueName: \"kubernetes.io/projected/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-api-access-8xw29\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.250859 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.250824 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.251056 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.250875 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c707a275-3290-4ec7-973a-a8b5629b99f7-crio-socket\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.251056 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.250895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.251056 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.250917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c707a275-3290-4ec7-973a-a8b5629b99f7-data-volume\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.251056 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:10.250968 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:10.251056 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.250976 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c707a275-3290-4ec7-973a-a8b5629b99f7-crio-socket\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.251056 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:10.251013 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.251056 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:10.251036 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm podName:c707a275-3290-4ec7-973a-a8b5629b99f7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:10.751016406 +0000 UTC m=+76.247315659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vnd8r" (UID: "c707a275-3290-4ec7-973a-a8b5629b99f7") : configmap "kube-rbac-proxy" not found Jul 03 19:11:10.251056 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:10.251059 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls podName:c707a275-3290-4ec7-973a-a8b5629b99f7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:10.751047865 +0000 UTC m=+76.247347084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vnd8r" (UID: "c707a275-3290-4ec7-973a-a8b5629b99f7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.251530 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.251081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xw29\" (UniqueName: \"kubernetes.io/projected/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-api-access-8xw29\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.251530 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.251212 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c707a275-3290-4ec7-973a-a8b5629b99f7-data-volume\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.258304 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.258254 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xw29\" (UniqueName: \"kubernetes.io/projected/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-api-access-8xw29\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.319440 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.319356 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:11:10.319848 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.319796 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/0.log" Jul 03 19:11:10.319848 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.319835 2580 generic.go:356] "Generic (PLEG): container finished" podID="6929e3c8-865f-456c-8d1e-061a213fad05" containerID="491271d66a431b1a4582bab4d5daad7449e42dbbc8d3d4eee07cf26ad4022f73" exitCode=255 Jul 03 19:11:10.319957 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.319921 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" event={"ID":"6929e3c8-865f-456c-8d1e-061a213fad05","Type":"ContainerDied","Data":"491271d66a431b1a4582bab4d5daad7449e42dbbc8d3d4eee07cf26ad4022f73"} Jul 03 19:11:10.320020 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.320006 2580 scope.go:117] "RemoveContainer" containerID="65e58827983ac433b00ed444be69e369dbe602b67f1cb1c5004d78647364aab2" Jul 03 19:11:10.320112 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.320098 2580 scope.go:117] "RemoveContainer" containerID="491271d66a431b1a4582bab4d5daad7449e42dbbc8d3d4eee07cf26ad4022f73" Jul 03 19:11:10.320337 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:10.320318 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nthgs_openshift-console-operator(6929e3c8-865f-456c-8d1e-061a213fad05)\"" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" podUID="6929e3c8-865f-456c-8d1e-061a213fad05" Jul 03 19:11:10.755720 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.755689 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.755920 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:10.755768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:10.755920 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:10.755868 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.755920 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:10.755881 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:10.756080 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:10.755950 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls podName:c707a275-3290-4ec7-973a-a8b5629b99f7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:11.755930112 +0000 UTC m=+77.252229331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vnd8r" (UID: "c707a275-3290-4ec7-973a-a8b5629b99f7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.756080 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:10.755970 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm podName:c707a275-3290-4ec7-973a-a8b5629b99f7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:11.755960025 +0000 UTC m=+77.252259244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vnd8r" (UID: "c707a275-3290-4ec7-973a-a8b5629b99f7") : configmap "kube-rbac-proxy" not found Jul 03 19:11:11.324977 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:11.324950 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:11:11.325359 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:11.325274 2580 scope.go:117] "RemoveContainer" containerID="491271d66a431b1a4582bab4d5daad7449e42dbbc8d3d4eee07cf26ad4022f73" Jul 03 19:11:11.325428 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:11.325410 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nthgs_openshift-console-operator(6929e3c8-865f-456c-8d1e-061a213fad05)\"" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" podUID="6929e3c8-865f-456c-8d1e-061a213fad05" Jul 03 19:11:11.764521 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:11.764465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:11.764723 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:11.764571 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:11.764723 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:11.764590 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:11.764723 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:11.764659 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm podName:c707a275-3290-4ec7-973a-a8b5629b99f7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:13.764640624 +0000 UTC m=+79.260939864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vnd8r" (UID: "c707a275-3290-4ec7-973a-a8b5629b99f7") : configmap "kube-rbac-proxy" not found Jul 03 19:11:11.764723 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:11.764715 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:11.764868 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:11.764772 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls podName:c707a275-3290-4ec7-973a-a8b5629b99f7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:13.764758115 +0000 UTC m=+79.261057335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vnd8r" (UID: "c707a275-3290-4ec7-973a-a8b5629b99f7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:11.841800 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:11.841771 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-782f6_74dce66b-24ed-4967-a4a2-8b7710b45015/dns-node-resolver/0.log" Jul 03 19:11:13.242782 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:13.242755 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v68d2_e93e7739-0a8b-4f3f-9a04-6dfdef436237/node-ca/0.log" Jul 03 19:11:13.277338 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:13.277290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-x2cpp\" (UID: \"3963c691-f812-46a6-8981-e7c299e5d697\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:13.277505 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:13.277441 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 19:11:13.277542 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:13.277516 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls podName:3963c691-f812-46a6-8981-e7c299e5d697 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:21.277500661 +0000 UTC m=+86.773799880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-x2cpp" (UID: "3963c691-f812-46a6-8981-e7c299e5d697") : secret "samples-operator-tls" not found Jul 03 19:11:13.478988 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:13.478946 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:13.478988 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:13.478992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:13.479229 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:13.479085 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 19:11:13.479229 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:13.479136 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs podName:07a6fca2-14ed-4971-aa93-2f928fbfcf7c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:21.479123891 +0000 UTC m=+86.975423110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs") pod "router-default-b8b6fffc9-ks2dx" (UID: "07a6fca2-14ed-4971-aa93-2f928fbfcf7c") : secret "router-metrics-certs-default" not found Jul 03 19:11:13.479229 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:13.479150 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle podName:07a6fca2-14ed-4971-aa93-2f928fbfcf7c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:21.479145027 +0000 UTC m=+86.975444246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle") pod "router-default-b8b6fffc9-ks2dx" (UID: "07a6fca2-14ed-4971-aa93-2f928fbfcf7c") : configmap references non-existent config key: service-ca.crt Jul 03 19:11:13.781423 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:13.781366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:13.781619 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:13.781464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:13.781619 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:13.781495 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:13.781619 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:13.781568 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm podName:c707a275-3290-4ec7-973a-a8b5629b99f7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:17.781552032 +0000 UTC m=+83.277851270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vnd8r" (UID: "c707a275-3290-4ec7-973a-a8b5629b99f7") : configmap "kube-rbac-proxy" not found Jul 03 19:11:13.781619 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:13.781600 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:13.781772 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:13.781648 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls podName:c707a275-3290-4ec7-973a-a8b5629b99f7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:17.781636207 +0000 UTC m=+83.277935426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vnd8r" (UID: "c707a275-3290-4ec7-973a-a8b5629b99f7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:14.042018 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:14.041935 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x6tdp_48a7b9f2-395c-41f2-8faa-25c05e793fb8/serve-healthcheck-canary/0.log" Jul 03 19:11:16.078500 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:16.078457 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:16.078885 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:16.078525 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:16.078885 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:16.078870 2580 scope.go:117] "RemoveContainer" containerID="491271d66a431b1a4582bab4d5daad7449e42dbbc8d3d4eee07cf26ad4022f73" Jul 03 19:11:16.079044 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:16.079023 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nthgs_openshift-console-operator(6929e3c8-865f-456c-8d1e-061a213fad05)\"" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" podUID="6929e3c8-865f-456c-8d1e-061a213fad05" Jul 03 19:11:17.812282 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:17.812130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:17.812282 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:17.812197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:17.812282 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:17.812249 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:17.812711 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:17.812324 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:17.812711 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:17.812349 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm podName:c707a275-3290-4ec7-973a-a8b5629b99f7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:25.812329208 +0000 UTC m=+91.308628428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vnd8r" (UID: "c707a275-3290-4ec7-973a-a8b5629b99f7") : configmap "kube-rbac-proxy" not found Jul 03 19:11:17.812711 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:17.812373 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls podName:c707a275-3290-4ec7-973a-a8b5629b99f7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:25.812362587 +0000 UTC m=+91.308661806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vnd8r" (UID: "c707a275-3290-4ec7-973a-a8b5629b99f7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:21.339980 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:21.339940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-x2cpp\" (UID: \"3963c691-f812-46a6-8981-e7c299e5d697\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:21.342352 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:21.342330 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3963c691-f812-46a6-8981-e7c299e5d697-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-x2cpp\" (UID: \"3963c691-f812-46a6-8981-e7c299e5d697\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:21.448702 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:21.448663 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" Jul 03 19:11:21.541875 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:21.541823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:21.541875 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:21.541867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:21.542073 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:21.542044 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle podName:07a6fca2-14ed-4971-aa93-2f928fbfcf7c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:37.542016814 +0000 UTC m=+103.038316047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle") pod "router-default-b8b6fffc9-ks2dx" (UID: "07a6fca2-14ed-4971-aa93-2f928fbfcf7c") : configmap references non-existent config key: service-ca.crt Jul 03 19:11:21.545185 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:21.545160 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-metrics-certs\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:21.573639 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:21.573602 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp"] Jul 03 19:11:22.359103 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:22.359064 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" event={"ID":"3963c691-f812-46a6-8981-e7c299e5d697","Type":"ContainerStarted","Data":"bcd115164daad671b0167425745386427a5bd07ebc3dd7475ad01f6ded36fa0d"} Jul 03 19:11:24.368315 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:24.368279 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" event={"ID":"3963c691-f812-46a6-8981-e7c299e5d697","Type":"ContainerStarted","Data":"55ead5b57b9e6845c8b940448a0c773a539914db826dbca684ca681d6bbb85e2"} Jul 03 19:11:24.368695 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:24.368333 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" event={"ID":"3963c691-f812-46a6-8981-e7c299e5d697","Type":"ContainerStarted","Data":"2a7945d4a58e955220c139c624498c59cc0c6022118aa8ee5e272059046fadba"} Jul 03 19:11:24.383762 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:24.383708 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-x2cpp" podStartSLOduration=17.553102288 podStartE2EDuration="19.383693868s" totalImagesPullingTime="1.83059158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:24.382890042 +0000 UTC m=+89.879189284" watchObservedRunningTime="2026-07-03 19:11:24.383693868 +0000 UTC m=+89.879993109" Jul 03 19:11:25.876948 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:25.876909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:25.877336 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:25.876964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:25.877336 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:25.877054 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:25.877336 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:11:25.877107 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls podName:c707a275-3290-4ec7-973a-a8b5629b99f7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:41.877091788 +0000 UTC m=+107.373391007 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vnd8r" (UID: "c707a275-3290-4ec7-973a-a8b5629b99f7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:25.877482 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:25.877462 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c707a275-3290-4ec7-973a-a8b5629b99f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:28.025755 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:28.025719 2580 scope.go:117] "RemoveContainer" containerID="491271d66a431b1a4582bab4d5daad7449e42dbbc8d3d4eee07cf26ad4022f73" Jul 03 19:11:28.382076 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:28.381994 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:11:28.382245 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:28.382100 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" event={"ID":"6929e3c8-865f-456c-8d1e-061a213fad05","Type":"ContainerStarted","Data":"b413c425f56cf831df7da13ac6d5fc767d72133ba6045a35ed13981e5dc82638"} Jul 03 19:11:28.382508 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:28.382483 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:28.397183 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:28.397123 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" podStartSLOduration=20.98289181 podStartE2EDuration="23.397106367s" totalImagesPullingTime="2.414214557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:28.396940133 +0000 UTC m=+93.893239376" watchObservedRunningTime="2026-07-03 19:11:28.397106367 +0000 UTC m=+93.893405608" Jul 03 19:11:28.576711 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:28.576675 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-nthgs" Jul 03 19:11:31.489570 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.489534 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp"] Jul 03 19:11:31.492576 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.492555 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:11:31.495584 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.495565 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 03 19:11:31.495584 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.495572 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 03 19:11:31.496678 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.496659 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 03 19:11:31.496839 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.496824 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 03 19:11:31.507451 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.507423 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp"] Jul 03 19:11:31.522754 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.522730 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s"] Jul 03 19:11:31.531342 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.531323 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s" Jul 03 19:11:31.533436 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.533415 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 03 19:11:31.533520 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.533443 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gws97\"" Jul 03 19:11:31.533520 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.533415 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 03 19:11:31.535851 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.535828 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s"] Jul 03 19:11:31.620387 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.620350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3778b723-844c-4764-8e1e-56c11c76ad5f-tmp\") pod \"klusterlet-addon-workmgr-5dc6687c6d-slfkp\" (UID: \"3778b723-844c-4764-8e1e-56c11c76ad5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:11:31.620547 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.620392 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea0ff22d-d38b-41b9-89be-42761dcddc93-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r2p6s\" (UID: \"ea0ff22d-d38b-41b9-89be-42761dcddc93\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s" Jul 03 19:11:31.620547 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.620466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3778b723-844c-4764-8e1e-56c11c76ad5f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dc6687c6d-slfkp\" (UID: \"3778b723-844c-4764-8e1e-56c11c76ad5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:11:31.620547 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.620514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7qpb\" (UniqueName: \"kubernetes.io/projected/3778b723-844c-4764-8e1e-56c11c76ad5f-kube-api-access-b7qpb\") pod \"klusterlet-addon-workmgr-5dc6687c6d-slfkp\" (UID: \"3778b723-844c-4764-8e1e-56c11c76ad5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:11:31.620547 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.620540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea0ff22d-d38b-41b9-89be-42761dcddc93-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-r2p6s\" (UID: \"ea0ff22d-d38b-41b9-89be-42761dcddc93\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s" Jul 03 19:11:31.721820 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.721783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3778b723-844c-4764-8e1e-56c11c76ad5f-tmp\") pod \"klusterlet-addon-workmgr-5dc6687c6d-slfkp\" (UID: \"3778b723-844c-4764-8e1e-56c11c76ad5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:11:31.722101 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.721829 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea0ff22d-d38b-41b9-89be-42761dcddc93-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r2p6s\" (UID: \"ea0ff22d-d38b-41b9-89be-42761dcddc93\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s" Jul 03 19:11:31.722101 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.721875 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3778b723-844c-4764-8e1e-56c11c76ad5f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dc6687c6d-slfkp\" (UID: \"3778b723-844c-4764-8e1e-56c11c76ad5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:11:31.722101 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.721919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7qpb\" (UniqueName: \"kubernetes.io/projected/3778b723-844c-4764-8e1e-56c11c76ad5f-kube-api-access-b7qpb\") pod \"klusterlet-addon-workmgr-5dc6687c6d-slfkp\" (UID: \"3778b723-844c-4764-8e1e-56c11c76ad5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:11:31.722101 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.721954 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea0ff22d-d38b-41b9-89be-42761dcddc93-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-r2p6s\" (UID: \"ea0ff22d-d38b-41b9-89be-42761dcddc93\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s" Jul 03 19:11:31.722360 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.722220 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3778b723-844c-4764-8e1e-56c11c76ad5f-tmp\") pod \"klusterlet-addon-workmgr-5dc6687c6d-slfkp\" (UID: \"3778b723-844c-4764-8e1e-56c11c76ad5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:11:31.722679 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.722658 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea0ff22d-d38b-41b9-89be-42761dcddc93-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-r2p6s\" (UID: \"ea0ff22d-d38b-41b9-89be-42761dcddc93\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s" Jul 03 19:11:31.724402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.724382 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea0ff22d-d38b-41b9-89be-42761dcddc93-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r2p6s\" (UID: \"ea0ff22d-d38b-41b9-89be-42761dcddc93\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s" Jul 03 19:11:31.724500 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.724442 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3778b723-844c-4764-8e1e-56c11c76ad5f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dc6687c6d-slfkp\" (UID: \"3778b723-844c-4764-8e1e-56c11c76ad5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:11:31.729830 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.729811 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7qpb\" (UniqueName: \"kubernetes.io/projected/3778b723-844c-4764-8e1e-56c11c76ad5f-kube-api-access-b7qpb\") pod \"klusterlet-addon-workmgr-5dc6687c6d-slfkp\" (UID: \"3778b723-844c-4764-8e1e-56c11c76ad5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:11:31.803490 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.803398 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:11:31.841442 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.841182 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s" Jul 03 19:11:31.936054 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.936025 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp"] Jul 03 19:11:31.939532 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:31.939495 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3778b723_844c_4764_8e1e_56c11c76ad5f.slice/crio-1e8fef868529daffce90ca31ebbb6e606c70cd7d072739dfef8bf653c530051e WatchSource:0}: Error finding container 1e8fef868529daffce90ca31ebbb6e606c70cd7d072739dfef8bf653c530051e: Status 404 returned error can't find the container with id 1e8fef868529daffce90ca31ebbb6e606c70cd7d072739dfef8bf653c530051e Jul 03 19:11:31.981489 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:31.981340 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s"] Jul 03 19:11:31.984129 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:31.984106 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0ff22d_d38b_41b9_89be_42761dcddc93.slice/crio-344e290d5873a748c8a84386d2f0d4f0761ab441e483f278a59117340e25414b WatchSource:0}: Error finding container 344e290d5873a748c8a84386d2f0d4f0761ab441e483f278a59117340e25414b: Status 404 returned error can't find the container with id 344e290d5873a748c8a84386d2f0d4f0761ab441e483f278a59117340e25414b Jul 03 19:11:32.398990 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:32.398957 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" event={"ID":"3778b723-844c-4764-8e1e-56c11c76ad5f","Type":"ContainerStarted","Data":"1e8fef868529daffce90ca31ebbb6e606c70cd7d072739dfef8bf653c530051e"} Jul 03 19:11:32.399956 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:32.399934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s" event={"ID":"ea0ff22d-d38b-41b9-89be-42761dcddc93","Type":"ContainerStarted","Data":"344e290d5873a748c8a84386d2f0d4f0761ab441e483f278a59117340e25414b"} Jul 03 19:11:32.730983 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:32.730948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:11:32.733183 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:32.733155 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e009a38c-af47-4270-b2c1-c8e90de2fb8a-metrics-tls\") pod \"dns-default-dvkr6\" (UID: \"e009a38c-af47-4270-b2c1-c8e90de2fb8a\") " pod="openshift-dns/dns-default-dvkr6" Jul 03 19:11:32.743146 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:32.743127 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8lvgc\"" Jul 03 19:11:32.751822 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:32.751796 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dvkr6" Jul 03 19:11:32.898954 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:32.898914 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dvkr6"] Jul 03 19:11:32.902257 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:32.902231 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode009a38c_af47_4270_b2c1_c8e90de2fb8a.slice/crio-8ba789a7eb1fb514f3adbe284c4fb9dc7e282ab349f323df1928a00f78999e55 WatchSource:0}: Error finding container 8ba789a7eb1fb514f3adbe284c4fb9dc7e282ab349f323df1928a00f78999e55: Status 404 returned error can't find the container with id 8ba789a7eb1fb514f3adbe284c4fb9dc7e282ab349f323df1928a00f78999e55 Jul 03 19:11:33.404866 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:33.404839 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dvkr6" event={"ID":"e009a38c-af47-4270-b2c1-c8e90de2fb8a","Type":"ContainerStarted","Data":"8ba789a7eb1fb514f3adbe284c4fb9dc7e282ab349f323df1928a00f78999e55"} Jul 03 19:11:34.410616 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:34.410573 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s" event={"ID":"ea0ff22d-d38b-41b9-89be-42761dcddc93","Type":"ContainerStarted","Data":"33ab00456a32ce70a8938926b2e1fec9ea95c8bbea4cda0cc98d26e80b75c811"} Jul 03 19:11:34.424162 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:34.424101 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r2p6s" podStartSLOduration=2.019472063 podStartE2EDuration="3.424084246s" totalImagesPullingTime="1.404612183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:34.423846953 +0000 UTC m=+99.920146198" watchObservedRunningTime="2026-07-03 19:11:34.424084246 +0000 UTC m=+99.920383489" Jul 03 19:11:35.416850 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:35.416749 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dvkr6" event={"ID":"e009a38c-af47-4270-b2c1-c8e90de2fb8a","Type":"ContainerStarted","Data":"1492db2dcf788e8bb7953ac0088b72a274e867f595fee82357fc9a960abf0d77"} Jul 03 19:11:35.416850 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:35.416813 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dvkr6" event={"ID":"e009a38c-af47-4270-b2c1-c8e90de2fb8a","Type":"ContainerStarted","Data":"5a7b1f412b368328e7d7ceb332d244eadcd23cf093c64841321dee259c354aba"} Jul 03 19:11:35.433055 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:35.433005 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dvkr6" podStartSLOduration=65.783126825 podStartE2EDuration="1m7.43298937s" totalImagesPullingTime="1.649862545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:35.432613844 +0000 UTC m=+100.928913130" watchObservedRunningTime="2026-07-03 19:11:35.43298937 +0000 UTC m=+100.929288623" Jul 03 19:11:36.420249 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:36.420218 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dvkr6" Jul 03 19:11:37.299125 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:37.299088 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q9zg2" Jul 03 19:11:37.566910 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:37.566809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:37.567541 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:37.567520 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a6fca2-14ed-4971-aa93-2f928fbfcf7c-service-ca-bundle\") pod \"router-default-b8b6fffc9-ks2dx\" (UID: \"07a6fca2-14ed-4971-aa93-2f928fbfcf7c\") " pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:37.572094 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:37.572075 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:37.710298 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:37.710252 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b8b6fffc9-ks2dx"] Jul 03 19:11:37.712749 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:37.712721 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a6fca2_14ed_4971_aa93_2f928fbfcf7c.slice/crio-ba9a33a4bb3ec11e312ae63961b40726bc0486d60781f411f0e47064d4f36b82 WatchSource:0}: Error finding container ba9a33a4bb3ec11e312ae63961b40726bc0486d60781f411f0e47064d4f36b82: Status 404 returned error can't find the container with id ba9a33a4bb3ec11e312ae63961b40726bc0486d60781f411f0e47064d4f36b82 Jul 03 19:11:38.433029 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:38.432990 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" event={"ID":"07a6fca2-14ed-4971-aa93-2f928fbfcf7c","Type":"ContainerStarted","Data":"88e3526c4902df25dcb096410ea39bba434f989ccb8a6019fef819d883d217a2"} Jul 03 19:11:38.433215 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:38.433048 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" event={"ID":"07a6fca2-14ed-4971-aa93-2f928fbfcf7c","Type":"ContainerStarted","Data":"ba9a33a4bb3ec11e312ae63961b40726bc0486d60781f411f0e47064d4f36b82"} Jul 03 19:11:38.453281 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:38.453217 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" podStartSLOduration=33.453201237 podStartE2EDuration="33.453201237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:38.451842052 +0000 UTC m=+103.948141293" watchObservedRunningTime="2026-07-03 19:11:38.453201237 +0000 UTC m=+103.949500509" Jul 03 19:11:38.572462 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:38.572417 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:38.575160 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:38.575097 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:39.436794 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:39.436761 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:39.438014 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:39.437992 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-b8b6fffc9-ks2dx" Jul 03 19:11:40.976155 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:40.976114 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d"] Jul 03 19:11:41.011010 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:41.010970 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d"] Jul 03 19:11:41.011185 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:41.011084 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d" Jul 03 19:11:41.013312 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:41.013289 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 03 19:11:41.013312 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:41.013305 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hwx55\"" Jul 03 19:11:41.095374 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:41.095343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f9941546-fcd6-4c5a-8cec-08e9f0060cd2-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fbf5d\" (UID: \"f9941546-fcd6-4c5a-8cec-08e9f0060cd2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d" Jul 03 19:11:41.196719 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:41.196682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f9941546-fcd6-4c5a-8cec-08e9f0060cd2-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fbf5d\" (UID: \"f9941546-fcd6-4c5a-8cec-08e9f0060cd2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d" Jul 03 19:11:41.199032 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:41.199009 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f9941546-fcd6-4c5a-8cec-08e9f0060cd2-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fbf5d\" (UID: \"f9941546-fcd6-4c5a-8cec-08e9f0060cd2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d" Jul 03 19:11:41.319446 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:41.319350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d" Jul 03 19:11:41.447736 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:41.447703 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d"] Jul 03 19:11:41.451216 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:41.451178 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9941546_fcd6_4c5a_8cec_08e9f0060cd2.slice/crio-7039a3c72229cb736e5ca8668be21c84494fae90f35d2b38214a6fda4178194f WatchSource:0}: Error finding container 7039a3c72229cb736e5ca8668be21c84494fae90f35d2b38214a6fda4178194f: Status 404 returned error can't find the container with id 7039a3c72229cb736e5ca8668be21c84494fae90f35d2b38214a6fda4178194f Jul 03 19:11:41.902663 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:41.902626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:41.904854 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:41.904823 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c707a275-3290-4ec7-973a-a8b5629b99f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnd8r\" (UID: \"c707a275-3290-4ec7-973a-a8b5629b99f7\") " pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:42.178397 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:42.178362 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vnd8r" Jul 03 19:11:42.318071 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:42.318026 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vnd8r"] Jul 03 19:11:42.321539 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:42.321505 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc707a275_3290_4ec7_973a_a8b5629b99f7.slice/crio-af62b6d827a9ca7f3b7994fdf838758205e3507b3dae292f204104f6da56519c WatchSource:0}: Error finding container af62b6d827a9ca7f3b7994fdf838758205e3507b3dae292f204104f6da56519c: Status 404 returned error can't find the container with id af62b6d827a9ca7f3b7994fdf838758205e3507b3dae292f204104f6da56519c Jul 03 19:11:42.448439 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:42.448313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vnd8r" event={"ID":"c707a275-3290-4ec7-973a-a8b5629b99f7","Type":"ContainerStarted","Data":"af62b6d827a9ca7f3b7994fdf838758205e3507b3dae292f204104f6da56519c"} Jul 03 19:11:42.449739 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:42.449700 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d" event={"ID":"f9941546-fcd6-4c5a-8cec-08e9f0060cd2","Type":"ContainerStarted","Data":"7039a3c72229cb736e5ca8668be21c84494fae90f35d2b38214a6fda4178194f"} Jul 03 19:11:43.455666 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:43.455630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d" event={"ID":"f9941546-fcd6-4c5a-8cec-08e9f0060cd2","Type":"ContainerStarted","Data":"a24265db1c78a9f49e3e1a17d0f85df7c3532cf5d8e8ad21ad12198620b88005"} Jul 03 19:11:43.456161 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:43.455852 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d" Jul 03 19:11:43.461471 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:43.461446 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d" Jul 03 19:11:43.470046 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:43.469988 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fbf5d" podStartSLOduration=2.293473736 podStartE2EDuration="3.469967749s" totalImagesPullingTime="1.176494013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:43.46915244 +0000 UTC m=+108.965451700" watchObservedRunningTime="2026-07-03 19:11:43.469967749 +0000 UTC m=+108.966266993" Jul 03 19:11:44.026040 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.026010 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg"] Jul 03 19:11:44.033686 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.033654 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.037717 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.037118 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 03 19:11:44.037717 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.037133 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2xz7w\"" Jul 03 19:11:44.037717 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.037426 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 03 19:11:44.037717 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.037429 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 03 19:11:44.037717 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.037651 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 03 19:11:44.037717 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.037662 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 03 19:11:44.039114 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.039088 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg"] Jul 03 19:11:44.121625 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.121580 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72160ddf-0d9c-486d-8418-62947203e91d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.121816 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.121638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72160ddf-0d9c-486d-8418-62947203e91d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.121816 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.121730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfmhg\" (UniqueName: \"kubernetes.io/projected/72160ddf-0d9c-486d-8418-62947203e91d-kube-api-access-tfmhg\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.121931 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.121831 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72160ddf-0d9c-486d-8418-62947203e91d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.222796 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.222759 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72160ddf-0d9c-486d-8418-62947203e91d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.222796 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.222810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72160ddf-0d9c-486d-8418-62947203e91d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.223056 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.222836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfmhg\" (UniqueName: \"kubernetes.io/projected/72160ddf-0d9c-486d-8418-62947203e91d-kube-api-access-tfmhg\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.223056 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.222890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72160ddf-0d9c-486d-8418-62947203e91d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.223744 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.223719 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72160ddf-0d9c-486d-8418-62947203e91d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.225662 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.225637 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72160ddf-0d9c-486d-8418-62947203e91d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.225662 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.225650 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72160ddf-0d9c-486d-8418-62947203e91d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.230833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.230805 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfmhg\" (UniqueName: \"kubernetes.io/projected/72160ddf-0d9c-486d-8418-62947203e91d-kube-api-access-tfmhg\") pod \"prometheus-operator-567f7b8b7c-8qbjg\" (UID: \"72160ddf-0d9c-486d-8418-62947203e91d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:44.345364 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:44.345285 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" Jul 03 19:11:46.054924 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:46.054861 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg"] Jul 03 19:11:46.057540 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:46.057435 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72160ddf_0d9c_486d_8418_62947203e91d.slice/crio-653b927b14417f4f383bc6b674c23e1fe74e19ed2bb634c898e26ca45d1a622c WatchSource:0}: Error finding container 653b927b14417f4f383bc6b674c23e1fe74e19ed2bb634c898e26ca45d1a622c: Status 404 returned error can't find the container with id 653b927b14417f4f383bc6b674c23e1fe74e19ed2bb634c898e26ca45d1a622c Jul 03 19:11:46.429732 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:46.429704 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dvkr6" Jul 03 19:11:46.468749 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:46.468715 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" event={"ID":"72160ddf-0d9c-486d-8418-62947203e91d","Type":"ContainerStarted","Data":"653b927b14417f4f383bc6b674c23e1fe74e19ed2bb634c898e26ca45d1a622c"} Jul 03 19:11:46.470540 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:46.470514 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vnd8r" event={"ID":"c707a275-3290-4ec7-973a-a8b5629b99f7","Type":"ContainerStarted","Data":"a8d30cb54426f99783ec3fb652a85dfce8f311d782df9be01f88dad2982542a2"} Jul 03 19:11:47.475551 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:47.475521 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" event={"ID":"72160ddf-0d9c-486d-8418-62947203e91d","Type":"ContainerStarted","Data":"14aacf614363b11c616eb4f925b5d31e67e49820bebf956245d3beee61f8fd27"} Jul 03 19:11:47.478740 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:47.478704 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vnd8r" event={"ID":"c707a275-3290-4ec7-973a-a8b5629b99f7","Type":"ContainerStarted","Data":"00428ef657d5d5f8591501b62902af4e8053525def20104c6e4b4113d8a305e3"} Jul 03 19:11:48.484787 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:48.484748 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" event={"ID":"72160ddf-0d9c-486d-8418-62947203e91d","Type":"ContainerStarted","Data":"990a9c59c4a526605a5374bda0f6d286532e02cd83f7437685c6748a4b236ca2"} Jul 03 19:11:48.501328 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:48.501255 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8qbjg" podStartSLOduration=3.168916804 podStartE2EDuration="4.501237196s" totalImagesPullingTime="1.332320392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:48.500347225 +0000 UTC m=+113.996646497" watchObservedRunningTime="2026-07-03 19:11:48.501237196 +0000 UTC m=+113.997536439" Jul 03 19:11:50.415280 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.415236 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nqh7p"] Jul 03 19:11:50.421804 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.421780 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.424065 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.424043 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 03 19:11:50.424445 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.424412 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 03 19:11:50.424659 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.424643 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 03 19:11:50.424757 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.424740 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ffmmx\"" Jul 03 19:11:50.493779 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.493745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vnd8r" event={"ID":"c707a275-3290-4ec7-973a-a8b5629b99f7","Type":"ContainerStarted","Data":"112e7730e50b32cf5f032a806ec8bf52d19f77d85143317d2ca799ad155c4023"} Jul 03 19:11:50.525586 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.525534 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vnd8r" podStartSLOduration=33.514002084 podStartE2EDuration="40.52551839s" totalImagesPullingTime="7.011516306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:11:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:50.524820785 +0000 UTC m=+116.021120018" watchObservedRunningTime="2026-07-03 19:11:50.52551839 +0000 UTC m=+116.021817652" Jul 03 19:11:50.570554 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.570512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b94c983-5280-49c3-b398-e272cea12c00-sys\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.570716 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.570562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-wtmp\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.570716 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.570650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-tls\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.570791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.570717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2b94c983-5280-49c3-b398-e272cea12c00-root\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.570791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.570759 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-textfile\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.570863 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.570803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4774d\" (UniqueName: \"kubernetes.io/projected/2b94c983-5280-49c3-b398-e272cea12c00-kube-api-access-4774d\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.570863 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.570839 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b94c983-5280-49c3-b398-e272cea12c00-metrics-client-ca\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.570923 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.570864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.570923 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.570885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-accelerators-collector-config\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672130 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-textfile\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672348 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672162 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4774d\" (UniqueName: \"kubernetes.io/projected/2b94c983-5280-49c3-b398-e272cea12c00-kube-api-access-4774d\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672348 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b94c983-5280-49c3-b398-e272cea12c00-metrics-client-ca\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672470 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672470 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-accelerators-collector-config\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672470 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b94c983-5280-49c3-b398-e272cea12c00-sys\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672607 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-wtmp\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672607 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672553 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b94c983-5280-49c3-b398-e272cea12c00-sys\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672704 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672623 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-wtmp\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672704 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-tls\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672704 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2b94c983-5280-49c3-b398-e272cea12c00-root\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672909 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672784 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-textfile\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.672909 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672820 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2b94c983-5280-49c3-b398-e272cea12c00-root\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.673007 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.672926 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b94c983-5280-49c3-b398-e272cea12c00-metrics-client-ca\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.673315 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.673286 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-accelerators-collector-config\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.675200 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.675172 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-tls\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.675200 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.675193 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b94c983-5280-49c3-b398-e272cea12c00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.679624 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.679603 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4774d\" (UniqueName: \"kubernetes.io/projected/2b94c983-5280-49c3-b398-e272cea12c00-kube-api-access-4774d\") pod \"node-exporter-nqh7p\" (UID: \"2b94c983-5280-49c3-b398-e272cea12c00\") " pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.730609 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:50.730561 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nqh7p" Jul 03 19:11:50.741281 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:50.741234 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b94c983_5280_49c3_b398_e272cea12c00.slice/crio-637286559acb3ab178456ee41678aa71600bb0ba5d1ab7e7a4948a22de1ae0f3 WatchSource:0}: Error finding container 637286559acb3ab178456ee41678aa71600bb0ba5d1ab7e7a4948a22de1ae0f3: Status 404 returned error can't find the container with id 637286559acb3ab178456ee41678aa71600bb0ba5d1ab7e7a4948a22de1ae0f3 Jul 03 19:11:51.498583 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:51.498528 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqh7p" event={"ID":"2b94c983-5280-49c3-b398-e272cea12c00","Type":"ContainerStarted","Data":"637286559acb3ab178456ee41678aa71600bb0ba5d1ab7e7a4948a22de1ae0f3"} Jul 03 19:11:52.504059 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:52.504026 2580 generic.go:356] "Generic (PLEG): container finished" podID="2b94c983-5280-49c3-b398-e272cea12c00" containerID="fbb21b1b209494d2999f0eb5f1fb4a5321c513f3fdaf277443db40d65e69f761" exitCode=0 Jul 03 19:11:52.504432 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:52.504068 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqh7p" event={"ID":"2b94c983-5280-49c3-b398-e272cea12c00","Type":"ContainerDied","Data":"fbb21b1b209494d2999f0eb5f1fb4a5321c513f3fdaf277443db40d65e69f761"} Jul 03 19:11:53.471576 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.471536 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7644bff745-97fm7"] Jul 03 19:11:53.474482 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.474466 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.476960 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.476895 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 03 19:11:53.476960 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.476898 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 03 19:11:53.477176 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.476968 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-n5f68\"" Jul 03 19:11:53.477176 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.476896 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 03 19:11:53.477176 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.476898 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5qllsjs3b3e7v\"" Jul 03 19:11:53.477176 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.477036 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 03 19:11:53.477176 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.476927 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 03 19:11:53.485154 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.485130 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7644bff745-97fm7"] Jul 03 19:11:53.512565 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.512531 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqh7p" event={"ID":"2b94c983-5280-49c3-b398-e272cea12c00","Type":"ContainerStarted","Data":"432ee9b615ed60e89c20ead8a8c330e5cc8d733bb03067096e89adfa79f63d28"} Jul 03 19:11:53.512920 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.512607 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqh7p" event={"ID":"2b94c983-5280-49c3-b398-e272cea12c00","Type":"ContainerStarted","Data":"252bea16c1480d37e487460edb17a71b87465f42d5ec25757914dea8c93fa548"} Jul 03 19:11:53.529580 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.529528 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nqh7p" podStartSLOduration=2.444053287 podStartE2EDuration="3.529511926s" totalImagesPullingTime="1.017197251s" totalInitContainerRuntime="68.261388ms" isStatefulPod=true podCreationTimestamp="2026-07-03 19:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:53.528763951 +0000 UTC m=+119.025063214" watchObservedRunningTime="2026-07-03 19:11:53.529511926 +0000 UTC m=+119.025811158" Jul 03 19:11:53.598239 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.598201 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.598239 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.598241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.598445 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.598299 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/689fbc04-4e11-40e3-88ec-f6c822508b6d-metrics-client-ca\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.598445 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.598353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.598445 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.598389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-tls\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.598445 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.598409 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8qt4\" (UniqueName: \"kubernetes.io/projected/689fbc04-4e11-40e3-88ec-f6c822508b6d-kube-api-access-h8qt4\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.598445 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.598438 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.598595 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.598460 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-grpc-tls\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.699659 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.699621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.699847 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.699680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/689fbc04-4e11-40e3-88ec-f6c822508b6d-metrics-client-ca\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.699847 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.699715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.699847 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.699735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-tls\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.699847 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.699753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8qt4\" (UniqueName: \"kubernetes.io/projected/689fbc04-4e11-40e3-88ec-f6c822508b6d-kube-api-access-h8qt4\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.699847 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.699784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.700104 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.699964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-grpc-tls\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.700158 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.700125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.700753 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.700471 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/689fbc04-4e11-40e3-88ec-f6c822508b6d-metrics-client-ca\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.702598 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.702567 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.702598 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.702590 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.702983 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.702961 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-grpc-tls\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.703074 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.703009 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.703212 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.703191 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-tls\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.703374 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.703354 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/689fbc04-4e11-40e3-88ec-f6c822508b6d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.708202 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.708180 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8qt4\" (UniqueName: \"kubernetes.io/projected/689fbc04-4e11-40e3-88ec-f6c822508b6d-kube-api-access-h8qt4\") pod \"thanos-querier-7644bff745-97fm7\" (UID: \"689fbc04-4e11-40e3-88ec-f6c822508b6d\") " pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.785193 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.785107 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:53.916881 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:53.916843 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7644bff745-97fm7"] Jul 03 19:11:53.919564 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:53.919535 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod689fbc04_4e11_40e3_88ec_f6c822508b6d.slice/crio-e77a3a1b18b1cfe03de9f497cfda2e3aeee0e37c58df1d7c7604dabfd6156639 WatchSource:0}: Error finding container e77a3a1b18b1cfe03de9f497cfda2e3aeee0e37c58df1d7c7604dabfd6156639: Status 404 returned error can't find the container with id e77a3a1b18b1cfe03de9f497cfda2e3aeee0e37c58df1d7c7604dabfd6156639 Jul 03 19:11:54.518347 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.518304 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" event={"ID":"689fbc04-4e11-40e3-88ec-f6c822508b6d","Type":"ContainerStarted","Data":"e77a3a1b18b1cfe03de9f497cfda2e3aeee0e37c58df1d7c7604dabfd6156639"} Jul 03 19:11:54.776874 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.776788 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5c95549cdc-vx7zt"] Jul 03 19:11:54.779020 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.778998 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:54.782393 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.782174 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 03 19:11:54.782393 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.782199 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 03 19:11:54.782393 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.782174 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6dwkn\"" Jul 03 19:11:54.782393 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.782241 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 03 19:11:54.782393 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.782190 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 03 19:11:54.782680 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.782607 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3jql8pq58titl\"" Jul 03 19:11:54.791187 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.791169 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c95549cdc-vx7zt"] Jul 03 19:11:54.911475 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.911446 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e435da54-0820-4091-a6f7-ad9c6d1d8117-secret-metrics-server-client-certs\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:54.911632 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.911484 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e435da54-0820-4091-a6f7-ad9c6d1d8117-secret-metrics-server-tls\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:54.911632 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.911513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e435da54-0820-4091-a6f7-ad9c6d1d8117-audit-log\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:54.911632 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.911596 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e435da54-0820-4091-a6f7-ad9c6d1d8117-client-ca-bundle\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:54.911802 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.911633 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prlvt\" (UniqueName: \"kubernetes.io/projected/e435da54-0820-4091-a6f7-ad9c6d1d8117-kube-api-access-prlvt\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:54.911802 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.911670 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e435da54-0820-4091-a6f7-ad9c6d1d8117-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:54.911802 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:54.911694 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e435da54-0820-4091-a6f7-ad9c6d1d8117-metrics-server-audit-profiles\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.013064 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.013025 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e435da54-0820-4091-a6f7-ad9c6d1d8117-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.013064 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.013073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e435da54-0820-4091-a6f7-ad9c6d1d8117-metrics-server-audit-profiles\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.013304 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.013152 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e435da54-0820-4091-a6f7-ad9c6d1d8117-secret-metrics-server-client-certs\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.013304 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.013189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e435da54-0820-4091-a6f7-ad9c6d1d8117-secret-metrics-server-tls\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.013304 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.013220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e435da54-0820-4091-a6f7-ad9c6d1d8117-audit-log\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.013304 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.013290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e435da54-0820-4091-a6f7-ad9c6d1d8117-client-ca-bundle\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.013486 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.013320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prlvt\" (UniqueName: \"kubernetes.io/projected/e435da54-0820-4091-a6f7-ad9c6d1d8117-kube-api-access-prlvt\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.013937 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.013869 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e435da54-0820-4091-a6f7-ad9c6d1d8117-audit-log\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.015559 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.015534 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 03 19:11:55.015679 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.015621 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 03 19:11:55.015744 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.015693 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 03 19:11:55.015744 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.015721 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 03 19:11:55.015744 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.015732 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3jql8pq58titl\"" Jul 03 19:11:55.021338 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.021313 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prlvt\" (UniqueName: \"kubernetes.io/projected/e435da54-0820-4091-a6f7-ad9c6d1d8117-kube-api-access-prlvt\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.024863 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.024674 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e435da54-0820-4091-a6f7-ad9c6d1d8117-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.025097 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.025070 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e435da54-0820-4091-a6f7-ad9c6d1d8117-metrics-server-audit-profiles\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.027144 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.027045 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e435da54-0820-4091-a6f7-ad9c6d1d8117-secret-metrics-server-tls\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.027795 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.027756 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e435da54-0820-4091-a6f7-ad9c6d1d8117-secret-metrics-server-client-certs\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.028926 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.028906 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e435da54-0820-4091-a6f7-ad9c6d1d8117-client-ca-bundle\") pod \"metrics-server-5c95549cdc-vx7zt\" (UID: \"e435da54-0820-4091-a6f7-ad9c6d1d8117\") " pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.092038 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.092006 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6dwkn\"" Jul 03 19:11:55.099866 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.099831 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:11:55.186812 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.186779 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj"] Jul 03 19:11:55.190626 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.190599 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" Jul 03 19:11:55.193356 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.192846 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-72smf\"" Jul 03 19:11:55.193356 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.193099 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 03 19:11:55.207107 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.200815 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj"] Jul 03 19:11:55.225672 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.225606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzwx9\" (UniqueName: \"kubernetes.io/projected/4ca6406c-be28-4e49-bf5a-f785be2b8a3b-kube-api-access-hzwx9\") pod \"monitoring-plugin-d5dcff7cf-jz5sj\" (UID: \"4ca6406c-be28-4e49-bf5a-f785be2b8a3b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" Jul 03 19:11:55.225672 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.225666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ca6406c-be28-4e49-bf5a-f785be2b8a3b-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jz5sj\" (UID: \"4ca6406c-be28-4e49-bf5a-f785be2b8a3b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" Jul 03 19:11:55.270393 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.270357 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c95549cdc-vx7zt"] Jul 03 19:11:55.326520 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.326414 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzwx9\" (UniqueName: \"kubernetes.io/projected/4ca6406c-be28-4e49-bf5a-f785be2b8a3b-kube-api-access-hzwx9\") pod \"monitoring-plugin-d5dcff7cf-jz5sj\" (UID: \"4ca6406c-be28-4e49-bf5a-f785be2b8a3b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" Jul 03 19:11:55.326520 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.326469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ca6406c-be28-4e49-bf5a-f785be2b8a3b-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jz5sj\" (UID: \"4ca6406c-be28-4e49-bf5a-f785be2b8a3b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" Jul 03 19:11:55.329407 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.329377 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ca6406c-be28-4e49-bf5a-f785be2b8a3b-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jz5sj\" (UID: \"4ca6406c-be28-4e49-bf5a-f785be2b8a3b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" Jul 03 19:11:55.338898 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.338872 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzwx9\" (UniqueName: \"kubernetes.io/projected/4ca6406c-be28-4e49-bf5a-f785be2b8a3b-kube-api-access-hzwx9\") pod \"monitoring-plugin-d5dcff7cf-jz5sj\" (UID: \"4ca6406c-be28-4e49-bf5a-f785be2b8a3b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" Jul 03 19:11:55.507115 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.507076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" Jul 03 19:11:55.763674 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:55.763633 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode435da54_0820_4091_a6f7_ad9c6d1d8117.slice/crio-c9f9a135565ff12696a00ce137350b17257c98ddd12472eaeae7380eae558837 WatchSource:0}: Error finding container c9f9a135565ff12696a00ce137350b17257c98ddd12472eaeae7380eae558837: Status 404 returned error can't find the container with id c9f9a135565ff12696a00ce137350b17257c98ddd12472eaeae7380eae558837 Jul 03 19:11:55.899817 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:55.899603 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj"] Jul 03 19:11:55.902720 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:55.902687 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca6406c_be28_4e49_bf5a_f785be2b8a3b.slice/crio-7fdc0f2e3a2f13456d4788ad64912148eb74aa613e9ccd0553e26db4b6d11e90 WatchSource:0}: Error finding container 7fdc0f2e3a2f13456d4788ad64912148eb74aa613e9ccd0553e26db4b6d11e90: Status 404 returned error can't find the container with id 7fdc0f2e3a2f13456d4788ad64912148eb74aa613e9ccd0553e26db4b6d11e90 Jul 03 19:11:56.508987 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.508948 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b7f846c6b-7h86c"] Jul 03 19:11:56.511309 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.511285 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.513513 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.513487 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 03 19:11:56.513775 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.513633 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 03 19:11:56.513840 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.513815 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 03 19:11:56.514461 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.514439 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 03 19:11:56.514595 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.514522 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 03 19:11:56.514678 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.514658 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 03 19:11:56.515022 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.515001 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q5m62\"" Jul 03 19:11:56.515760 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.515570 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 03 19:11:56.519883 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.519862 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 03 19:11:56.520566 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.520434 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7f846c6b-7h86c"] Jul 03 19:11:56.528683 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.528657 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" event={"ID":"e435da54-0820-4091-a6f7-ad9c6d1d8117","Type":"ContainerStarted","Data":"c9f9a135565ff12696a00ce137350b17257c98ddd12472eaeae7380eae558837"} Jul 03 19:11:56.531352 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.531322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" event={"ID":"689fbc04-4e11-40e3-88ec-f6c822508b6d","Type":"ContainerStarted","Data":"ebeb4dd87eed9c63e6227427a5c7b7e914aab0159aca6df7dd7a3057ca93d6cd"} Jul 03 19:11:56.531476 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.531396 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" event={"ID":"689fbc04-4e11-40e3-88ec-f6c822508b6d","Type":"ContainerStarted","Data":"4c2f1fe422346b15db3e22c7ac7c673e7424d50bcbc345ae0f43ac04af32a319"} Jul 03 19:11:56.531476 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.531458 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" event={"ID":"689fbc04-4e11-40e3-88ec-f6c822508b6d","Type":"ContainerStarted","Data":"4125d0492d194ef2b5da43d683e61bfca402c150bcd7e4d8c53cb788c0928333"} Jul 03 19:11:56.532994 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.532972 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" event={"ID":"4ca6406c-be28-4e49-bf5a-f785be2b8a3b","Type":"ContainerStarted","Data":"7fdc0f2e3a2f13456d4788ad64912148eb74aa613e9ccd0553e26db4b6d11e90"} Jul 03 19:11:56.536600 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.536568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-oauth-config\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.536685 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.536646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s29kt\" (UniqueName: \"kubernetes.io/projected/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-kube-api-access-s29kt\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.536754 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.536695 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-service-ca\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.536805 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.536756 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-oauth-serving-cert\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.536805 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.536787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-trusted-ca-bundle\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.536898 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.536822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-serving-cert\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.536943 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.536889 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-config\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.607324 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.607290 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 19:11:56.611581 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.611555 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.614228 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.614208 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 03 19:11:56.614473 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.614456 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 03 19:11:56.614814 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.614797 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 03 19:11:56.614902 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.614816 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 03 19:11:56.614902 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.614855 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 03 19:11:56.614999 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.614893 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 03 19:11:56.615178 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.615053 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 03 19:11:56.615697 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.615470 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 03 19:11:56.615697 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.615503 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kwv6z\"" Jul 03 19:11:56.615697 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.615554 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 03 19:11:56.615697 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.615554 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1ihilftcg5bp6\"" Jul 03 19:11:56.615697 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.615593 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 03 19:11:56.615697 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.615634 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 03 19:11:56.615697 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.615646 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 03 19:11:56.617596 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.617440 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 03 19:11:56.618697 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.618671 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 03 19:11:56.628494 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.628400 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 19:11:56.638629 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.638605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-config\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.638819 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.638800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639006 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.638990 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639143 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639320 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639435 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639324 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639435 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639435 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639380 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-config\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639435 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639406 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639435 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639437 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-oauth-config\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.639698 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639483 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-config-out\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639698 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-web-config\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639698 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639698 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639698 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639596 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.639698 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s29kt\" (UniqueName: \"kubernetes.io/projected/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-kube-api-access-s29kt\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.639698 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-service-ca\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.639698 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639697 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.640100 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.640100 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639775 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.640100 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-oauth-serving-cert\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.640100 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgvjk\" (UniqueName: \"kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-kube-api-access-lgvjk\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.640100 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639858 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.640100 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-trusted-ca-bundle\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.640100 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639907 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.640100 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.640100 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.639981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-serving-cert\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.640594 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.640320 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-config\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.641592 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.641568 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-service-ca\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.643254 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.643209 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-trusted-ca-bundle\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.646172 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.646124 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-oauth-serving-cert\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.648896 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.648400 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-serving-cert\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.650798 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.650776 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-oauth-config\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.652569 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.652529 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s29kt\" (UniqueName: \"kubernetes.io/projected/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-kube-api-access-s29kt\") pod \"console-b7f846c6b-7h86c\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.740692 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.740742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.740772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-config\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.740796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.740833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-config-out\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.740856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-web-config\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.740895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.740922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.740948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.740982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.741020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.741048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.741079 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgvjk\" (UniqueName: \"kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-kube-api-access-lgvjk\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.741335 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.741106 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.742183 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.741134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.742183 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.741165 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.742183 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.741212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.742183 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.741280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.742183 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.741671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.742183 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.741712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.742183 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.742047 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.742850 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.742729 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.743821 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.743717 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.743928 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.743905 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.758581 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.758519 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.760125 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.759364 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.760125 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.759897 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.761634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.761523 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.762912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.761870 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-config-out\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.762912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.762007 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.762912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.762360 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.762912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.762408 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.762912 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.762473 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.764362 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.763983 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-config\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.766091 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.766027 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.773000 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.772888 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.774083 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.774004 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.774556 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.774534 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.775351 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.775306 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-web-config\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.775595 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.775481 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgvjk\" (UniqueName: \"kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-kube-api-access-lgvjk\") pod \"prometheus-k8s-0\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:56.824604 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.824560 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:11:56.925825 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:56.925607 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:11:57.016729 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:57.016555 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7f846c6b-7h86c"] Jul 03 19:11:57.267503 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:57.267469 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 19:11:57.538323 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:57.538214 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7f846c6b-7h86c" event={"ID":"28a955e8-422e-4da4-ae5f-6ba29e24c2d7","Type":"ContainerStarted","Data":"70348abc043fd517ba9f4760a9d7b776cea199404e459def5ea8f614560d37df"} Jul 03 19:11:57.936206 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:11:57.936176 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092e06f8_31a1_47ea_8cb9_650559aeb303.slice/crio-83be2540e279795b7cb0ba64001a3ecf06a26770855f1841b6976ebd2cc751f9 WatchSource:0}: Error finding container 83be2540e279795b7cb0ba64001a3ecf06a26770855f1841b6976ebd2cc751f9: Status 404 returned error can't find the container with id 83be2540e279795b7cb0ba64001a3ecf06a26770855f1841b6976ebd2cc751f9 Jul 03 19:11:58.545503 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.545407 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerStarted","Data":"83be2540e279795b7cb0ba64001a3ecf06a26770855f1841b6976ebd2cc751f9"} Jul 03 19:11:58.547535 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.547496 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" event={"ID":"e435da54-0820-4091-a6f7-ad9c6d1d8117","Type":"ContainerStarted","Data":"55efc8b37043966f9ffa452d8bcb02faea4762fb51370c6ad7505322da392412"} Jul 03 19:11:58.551422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.550922 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" event={"ID":"689fbc04-4e11-40e3-88ec-f6c822508b6d","Type":"ContainerStarted","Data":"9a1fd3e0f138f5a2fce9fdda59309010e7040b85f86d12734cbf79a087a85d06"} Jul 03 19:11:58.551422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.550994 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" event={"ID":"689fbc04-4e11-40e3-88ec-f6c822508b6d","Type":"ContainerStarted","Data":"5842a4503ea0610be106f32360f81df0dca10f62f240e551d467ee93e5d5ce35"} Jul 03 19:11:58.551422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.551035 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" event={"ID":"689fbc04-4e11-40e3-88ec-f6c822508b6d","Type":"ContainerStarted","Data":"2d3347aebd3d05c5dabd8d1d9e557a9e347889ee6634c60ae62cdb89a3eb4f2b"} Jul 03 19:11:58.551422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.551078 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:11:58.554057 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.553334 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" event={"ID":"4ca6406c-be28-4e49-bf5a-f785be2b8a3b","Type":"ContainerStarted","Data":"21de794dea7940c0a6eecca3619274cbf26a24263fe816530ab2e8022e6a29ce"} Jul 03 19:11:58.554057 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.553718 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" Jul 03 19:11:58.561867 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.561839 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" Jul 03 19:11:58.564906 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.564850 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" podStartSLOduration=2.338643562 podStartE2EDuration="4.564831512s" totalImagesPullingTime="2.22618795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:58.564179187 +0000 UTC m=+124.060478456" watchObservedRunningTime="2026-07-03 19:11:58.564831512 +0000 UTC m=+124.061130756" Jul 03 19:11:58.585437 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.585372 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" podStartSLOduration=2.5267058479999998 podStartE2EDuration="5.585351057s" totalImagesPullingTime="3.058645209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:58.58431222 +0000 UTC m=+124.080611453" watchObservedRunningTime="2026-07-03 19:11:58.585351057 +0000 UTC m=+124.081650304" Jul 03 19:11:58.602130 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:11:58.602064 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jz5sj" podStartSLOduration=1.5112568880000001 podStartE2EDuration="3.602040265s" totalImagesPullingTime="2.090783377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:58.601382588 +0000 UTC m=+124.097681853" watchObservedRunningTime="2026-07-03 19:11:58.602040265 +0000 UTC m=+124.098339509" Jul 03 19:12:00.565933 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:00.565895 2580 generic.go:356] "Generic (PLEG): container finished" podID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerID="a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63" exitCode=0 Jul 03 19:12:00.566346 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:00.565971 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerDied","Data":"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63"} Jul 03 19:12:00.567859 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:00.567764 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7f846c6b-7h86c" event={"ID":"28a955e8-422e-4da4-ae5f-6ba29e24c2d7","Type":"ContainerStarted","Data":"978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760"} Jul 03 19:12:00.612938 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:00.612812 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b7f846c6b-7h86c" podStartSLOduration=1.35545015 podStartE2EDuration="4.612794833s" totalImagesPullingTime="3.257344683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:12:00.611370325 +0000 UTC m=+126.107669588" watchObservedRunningTime="2026-07-03 19:12:00.612794833 +0000 UTC m=+126.109094075" Jul 03 19:12:04.566824 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:04.566787 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7644bff745-97fm7" Jul 03 19:12:04.590543 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:04.590505 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerStarted","Data":"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71"} Jul 03 19:12:04.590727 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:04.590581 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerStarted","Data":"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563"} Jul 03 19:12:04.590727 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:04.590619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerStarted","Data":"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa"} Jul 03 19:12:04.590727 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:04.590659 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerStarted","Data":"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454"} Jul 03 19:12:04.590727 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:04.590697 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerStarted","Data":"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf"} Jul 03 19:12:04.590929 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:04.590734 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerStarted","Data":"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4"} Jul 03 19:12:04.619122 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:04.619064 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.114083188 podStartE2EDuration="8.619047437s" totalImagesPullingTime="5.485852482s" totalInitContainerRuntime="19.111767ms" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:12:04.617114502 +0000 UTC m=+130.113413767" watchObservedRunningTime="2026-07-03 19:12:04.619047437 +0000 UTC m=+130.115346679" Jul 03 19:12:04.826141 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:04.826029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:12:04.828407 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:04.828376 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f18c8179-6720-4e16-84aa-5c360dcf7a9a-metrics-certs\") pod \"network-metrics-daemon-qjp6f\" (UID: \"f18c8179-6720-4e16-84aa-5c360dcf7a9a\") " pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:12:05.038507 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:05.038472 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwb25\"" Jul 03 19:12:05.045822 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:05.045796 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjp6f" Jul 03 19:12:05.183991 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:05.183875 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qjp6f"] Jul 03 19:12:05.186842 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:12:05.186810 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18c8179_6720_4e16_84aa_5c360dcf7a9a.slice/crio-8bc01c8bbbdfd90aad19d79ee1de5adb5196375eaaeee69d3e4316e91d5d83ff WatchSource:0}: Error finding container 8bc01c8bbbdfd90aad19d79ee1de5adb5196375eaaeee69d3e4316e91d5d83ff: Status 404 returned error can't find the container with id 8bc01c8bbbdfd90aad19d79ee1de5adb5196375eaaeee69d3e4316e91d5d83ff Jul 03 19:12:05.595711 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:05.595670 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjp6f" event={"ID":"f18c8179-6720-4e16-84aa-5c360dcf7a9a","Type":"ContainerStarted","Data":"8bc01c8bbbdfd90aad19d79ee1de5adb5196375eaaeee69d3e4316e91d5d83ff"} Jul 03 19:12:06.604635 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:06.604536 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjp6f" event={"ID":"f18c8179-6720-4e16-84aa-5c360dcf7a9a","Type":"ContainerStarted","Data":"77854ff4a747255bd3cae07e26e71605b1b6835a7ad3c71e0ec8a54dfc38d35b"} Jul 03 19:12:06.604635 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:06.604589 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjp6f" event={"ID":"f18c8179-6720-4e16-84aa-5c360dcf7a9a","Type":"ContainerStarted","Data":"d6acd8ae58d4ee46969e0bc519c3343f61d7308e431ccae6aa078b6c6710a887"} Jul 03 19:12:06.620201 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:06.620149 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qjp6f" podStartSLOduration=130.55375485 podStartE2EDuration="2m11.620133313s" totalImagesPullingTime="1.066378463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:12:06.618400486 +0000 UTC m=+132.114699761" watchObservedRunningTime="2026-07-03 19:12:06.620133313 +0000 UTC m=+132.116432551" Jul 03 19:12:06.825360 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:06.825316 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:12:06.825531 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:06.825400 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:12:06.830321 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:06.830299 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:12:06.927545 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:06.927505 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:12:07.612868 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:07.612834 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:12:13.635818 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:13.635671 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" event={"ID":"3778b723-844c-4764-8e1e-56c11c76ad5f","Type":"ContainerStarted","Data":"e413dbbe54da8991e287cd1622b6bae97f57347e90cfb6e8530789ea3f876552"} Jul 03 19:12:13.637974 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:13.636615 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:12:13.640978 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:13.640949 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" Jul 03 19:12:13.655027 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:13.654969 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc6687c6d-slfkp" podStartSLOduration=1.541161005 podStartE2EDuration="42.65494929s" totalImagesPullingTime="41.113788285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:12:13.654183282 +0000 UTC m=+139.150482527" watchObservedRunningTime="2026-07-03 19:12:13.65494929 +0000 UTC m=+139.151248533" Jul 03 19:12:15.100603 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:15.100552 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:12:15.100995 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:15.100632 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:12:34.718763 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:34.718732 2580 generic.go:356] "Generic (PLEG): container finished" podID="a976ac92-4645-440d-af46-c5d9b51aa551" containerID="2a34827f6675bff725ec0cc4f91be1b88a2d448f4c476816fc2c9f9f9fb5b078" exitCode=0 Jul 03 19:12:34.719177 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:34.718809 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" event={"ID":"a976ac92-4645-440d-af46-c5d9b51aa551","Type":"ContainerDied","Data":"2a34827f6675bff725ec0cc4f91be1b88a2d448f4c476816fc2c9f9f9fb5b078"} Jul 03 19:12:34.719218 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:34.719183 2580 scope.go:117] "RemoveContainer" containerID="2a34827f6675bff725ec0cc4f91be1b88a2d448f4c476816fc2c9f9f9fb5b078" Jul 03 19:12:35.105898 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:35.105811 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:12:35.109716 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:35.109694 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5c95549cdc-vx7zt" Jul 03 19:12:35.727425 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:35.727387 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-4zbpv" event={"ID":"a976ac92-4645-440d-af46-c5d9b51aa551","Type":"ContainerStarted","Data":"29358c8883671213b9857ac9598d8e21df854470e52772d25f94efe9065bb7d9"} Jul 03 19:12:56.927685 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:56.927588 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:12:56.943787 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:56.943757 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:12:57.836938 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:12:57.836909 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:14.966463 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:14.966423 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 19:13:14.967002 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:14.966742 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="prometheus" containerID="cri-o://014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4" gracePeriod=600 Jul 03 19:13:14.967002 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:14.966774 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy" containerID="cri-o://f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563" gracePeriod=600 Jul 03 19:13:14.967002 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:14.966789 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="thanos-sidecar" containerID="cri-o://d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454" gracePeriod=600 Jul 03 19:13:14.967002 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:14.966839 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy-web" containerID="cri-o://847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa" gracePeriod=600 Jul 03 19:13:14.967002 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:14.966847 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="config-reloader" containerID="cri-o://6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf" gracePeriod=600 Jul 03 19:13:14.967002 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:14.966880 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71" gracePeriod=600 Jul 03 19:13:15.233972 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.233938 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.361822 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.361784 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-grpc-tls\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.361822 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.361825 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-0\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362067 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.361855 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-tls\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362067 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.361876 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-metrics-client-ca\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362067 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.361899 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-trusted-ca-bundle\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362067 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.361976 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-tls-assets\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362067 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.362028 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-metrics-client-certs\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362361 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.362076 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-kube-rbac-proxy\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362361 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.362108 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-1\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362361 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.362145 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-config\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362361 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.362170 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-kubelet-serving-ca-bundle\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362361 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.362212 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-config-out\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362361 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.362238 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-serving-certs-ca-bundle\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362361 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.362304 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-db\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362361 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.362318 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:15.362361 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.362332 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-thanos-prometheus-http-client-file\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.362779 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.362364 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:15.363556 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363059 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:15.363556 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363127 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgvjk\" (UniqueName: \"kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-kube-api-access-lgvjk\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.363556 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363184 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.363556 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363212 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-web-config\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.363556 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363213 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:15.363556 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363256 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.363556 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363249 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:15.363556 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363323 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-2\") pod \"092e06f8-31a1-47ea-8cb9-650559aeb303\" (UID: \"092e06f8-31a1-47ea-8cb9-650559aeb303\") " Jul 03 19:13:15.363556 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363338 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:15.364080 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363614 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.364080 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363633 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.364080 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363649 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.364080 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363665 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.364080 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363680 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-configmap-metrics-client-ca\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.364080 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.363694 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.365595 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.365546 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:15.365713 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.365616 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:13:15.365782 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.365746 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:15.365842 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.365776 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:15.365842 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.365807 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:15.366029 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.366001 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:15.366176 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.366139 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:15.366858 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.366823 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-config" (OuterVolumeSpecName: "config") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:15.366858 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.366841 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-kube-api-access-lgvjk" (OuterVolumeSpecName: "kube-api-access-lgvjk") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "kube-api-access-lgvjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:13:15.367096 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.367068 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:15.367345 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.367316 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-config-out" (OuterVolumeSpecName: "config-out") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:13:15.367419 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.367359 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:13:15.367873 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.367850 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:15.378475 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.378446 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-web-config" (OuterVolumeSpecName: "web-config") pod "092e06f8-31a1-47ea-8cb9-650559aeb303" (UID: "092e06f8-31a1-47ea-8cb9-650559aeb303"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:15.464304 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464238 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-kube-rbac-proxy\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464304 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464300 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-config\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464315 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-config-out\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464328 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-db\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464340 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464352 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgvjk\" (UniqueName: \"kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-kube-api-access-lgvjk\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464365 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464378 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-web-config\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464390 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464402 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/092e06f8-31a1-47ea-8cb9-650559aeb303-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464414 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-grpc-tls\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464425 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464439 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/092e06f8-31a1-47ea-8cb9-650559aeb303-tls-assets\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.464515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.464451 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/092e06f8-31a1-47ea-8cb9-650559aeb303-secret-metrics-client-certs\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:15.898462 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898425 2580 generic.go:356] "Generic (PLEG): container finished" podID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerID="5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71" exitCode=0 Jul 03 19:13:15.898462 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898451 2580 generic.go:356] "Generic (PLEG): container finished" podID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerID="f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563" exitCode=0 Jul 03 19:13:15.898462 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898457 2580 generic.go:356] "Generic (PLEG): container finished" podID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerID="847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa" exitCode=0 Jul 03 19:13:15.898462 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898463 2580 generic.go:356] "Generic (PLEG): container finished" podID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerID="d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454" exitCode=0 Jul 03 19:13:15.898462 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898468 2580 generic.go:356] "Generic (PLEG): container finished" podID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerID="6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf" exitCode=0 Jul 03 19:13:15.898462 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898473 2580 generic.go:356] "Generic (PLEG): container finished" podID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerID="014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4" exitCode=0 Jul 03 19:13:15.898896 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898506 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.898896 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898506 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerDied","Data":"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71"} Jul 03 19:13:15.898896 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898592 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerDied","Data":"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563"} Jul 03 19:13:15.898896 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerDied","Data":"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa"} Jul 03 19:13:15.898896 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898655 2580 scope.go:117] "RemoveContainer" containerID="5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71" Jul 03 19:13:15.898896 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898670 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerDied","Data":"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454"} Jul 03 19:13:15.898896 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898711 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerDied","Data":"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf"} Jul 03 19:13:15.898896 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898752 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerDied","Data":"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4"} Jul 03 19:13:15.898896 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.898792 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"092e06f8-31a1-47ea-8cb9-650559aeb303","Type":"ContainerDied","Data":"83be2540e279795b7cb0ba64001a3ecf06a26770855f1841b6976ebd2cc751f9"} Jul 03 19:13:15.906792 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.906656 2580 scope.go:117] "RemoveContainer" containerID="f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563" Jul 03 19:13:15.914542 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.914521 2580 scope.go:117] "RemoveContainer" containerID="847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa" Jul 03 19:13:15.921982 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.921906 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 19:13:15.922071 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.921980 2580 scope.go:117] "RemoveContainer" containerID="d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454" Jul 03 19:13:15.925788 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.925764 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 19:13:15.929690 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.929669 2580 scope.go:117] "RemoveContainer" containerID="6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf" Jul 03 19:13:15.937421 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.937402 2580 scope.go:117] "RemoveContainer" containerID="014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4" Jul 03 19:13:15.945256 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.945231 2580 scope.go:117] "RemoveContainer" containerID="a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63" Jul 03 19:13:15.950307 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950248 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 19:13:15.950601 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950587 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy-web" Jul 03 19:13:15.950642 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950603 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy-web" Jul 03 19:13:15.950642 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950614 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy" Jul 03 19:13:15.950642 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950619 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy" Jul 03 19:13:15.950642 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950626 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy-thanos" Jul 03 19:13:15.950642 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950632 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy-thanos" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950646 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="init-config-reloader" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950654 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="init-config-reloader" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950666 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="thanos-sidecar" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950671 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="thanos-sidecar" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950679 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="prometheus" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950684 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="prometheus" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950691 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="config-reloader" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950696 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="config-reloader" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950749 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="thanos-sidecar" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950757 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="prometheus" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950764 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy-thanos" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950770 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy-web" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950777 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="config-reloader" Jul 03 19:13:15.950785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.950783 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" containerName="kube-rbac-proxy" Jul 03 19:13:15.953060 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.953041 2580 scope.go:117] "RemoveContainer" containerID="5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71" Jul 03 19:13:15.953396 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:13:15.953365 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": container with ID starting with 5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71 not found: ID does not exist" containerID="5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71" Jul 03 19:13:15.953449 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.953404 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71"} err="failed to get container status \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": rpc error: code = NotFound desc = could not find container \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": container with ID starting with 5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71 not found: ID does not exist" Jul 03 19:13:15.953449 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.953437 2580 scope.go:117] "RemoveContainer" containerID="f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563" Jul 03 19:13:15.953695 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:13:15.953676 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": container with ID starting with f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563 not found: ID does not exist" containerID="f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563" Jul 03 19:13:15.953765 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.953704 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563"} err="failed to get container status \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": rpc error: code = NotFound desc = could not find container \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": container with ID starting with f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563 not found: ID does not exist" Jul 03 19:13:15.953765 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.953726 2580 scope.go:117] "RemoveContainer" containerID="847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa" Jul 03 19:13:15.953990 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:13:15.953971 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": container with ID starting with 847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa not found: ID does not exist" containerID="847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa" Jul 03 19:13:15.954056 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.954020 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa"} err="failed to get container status \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": rpc error: code = NotFound desc = could not find container \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": container with ID starting with 847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa not found: ID does not exist" Jul 03 19:13:15.954056 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.954041 2580 scope.go:117] "RemoveContainer" containerID="d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454" Jul 03 19:13:15.954379 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:13:15.954361 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": container with ID starting with d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454 not found: ID does not exist" containerID="d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454" Jul 03 19:13:15.954439 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.954383 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454"} err="failed to get container status \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": rpc error: code = NotFound desc = could not find container \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": container with ID starting with d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454 not found: ID does not exist" Jul 03 19:13:15.954439 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.954407 2580 scope.go:117] "RemoveContainer" containerID="6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf" Jul 03 19:13:15.954652 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:13:15.954636 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": container with ID starting with 6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf not found: ID does not exist" containerID="6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf" Jul 03 19:13:15.954717 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.954659 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf"} err="failed to get container status \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": rpc error: code = NotFound desc = could not find container \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": container with ID starting with 6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf not found: ID does not exist" Jul 03 19:13:15.954717 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.954678 2580 scope.go:117] "RemoveContainer" containerID="014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4" Jul 03 19:13:15.954956 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:13:15.954932 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": container with ID starting with 014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4 not found: ID does not exist" containerID="014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4" Jul 03 19:13:15.954994 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.954955 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4"} err="failed to get container status \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": rpc error: code = NotFound desc = could not find container \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": container with ID starting with 014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4 not found: ID does not exist" Jul 03 19:13:15.954994 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.954969 2580 scope.go:117] "RemoveContainer" containerID="a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63" Jul 03 19:13:15.955194 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:13:15.955177 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": container with ID starting with a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63 not found: ID does not exist" containerID="a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63" Jul 03 19:13:15.955245 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.955198 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63"} err="failed to get container status \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": rpc error: code = NotFound desc = could not find container \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": container with ID starting with a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63 not found: ID does not exist" Jul 03 19:13:15.955245 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.955212 2580 scope.go:117] "RemoveContainer" containerID="5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71" Jul 03 19:13:15.955457 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.955438 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71"} err="failed to get container status \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": rpc error: code = NotFound desc = could not find container \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": container with ID starting with 5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71 not found: ID does not exist" Jul 03 19:13:15.955527 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.955459 2580 scope.go:117] "RemoveContainer" containerID="f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563" Jul 03 19:13:15.955702 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.955682 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563"} err="failed to get container status \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": rpc error: code = NotFound desc = could not find container \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": container with ID starting with f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563 not found: ID does not exist" Jul 03 19:13:15.955702 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.955700 2580 scope.go:117] "RemoveContainer" containerID="847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa" Jul 03 19:13:15.955899 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.955880 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa"} err="failed to get container status \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": rpc error: code = NotFound desc = could not find container \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": container with ID starting with 847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa not found: ID does not exist" Jul 03 19:13:15.955971 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.955900 2580 scope.go:117] "RemoveContainer" containerID="d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454" Jul 03 19:13:15.956188 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.956155 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454"} err="failed to get container status \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": rpc error: code = NotFound desc = could not find container \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": container with ID starting with d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454 not found: ID does not exist" Jul 03 19:13:15.956284 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.956188 2580 scope.go:117] "RemoveContainer" containerID="6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf" Jul 03 19:13:15.956284 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.956164 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.956729 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.956708 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf"} err="failed to get container status \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": rpc error: code = NotFound desc = could not find container \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": container with ID starting with 6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf not found: ID does not exist" Jul 03 19:13:15.956729 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.956727 2580 scope.go:117] "RemoveContainer" containerID="014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4" Jul 03 19:13:15.957084 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.957037 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4"} err="failed to get container status \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": rpc error: code = NotFound desc = could not find container \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": container with ID starting with 014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4 not found: ID does not exist" Jul 03 19:13:15.957153 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.957086 2580 scope.go:117] "RemoveContainer" containerID="a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63" Jul 03 19:13:15.957437 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.957417 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63"} err="failed to get container status \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": rpc error: code = NotFound desc = could not find container \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": container with ID starting with a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63 not found: ID does not exist" Jul 03 19:13:15.957498 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.957437 2580 scope.go:117] "RemoveContainer" containerID="5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71" Jul 03 19:13:15.957768 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.957751 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71"} err="failed to get container status \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": rpc error: code = NotFound desc = could not find container \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": container with ID starting with 5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71 not found: ID does not exist" Jul 03 19:13:15.957840 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.957768 2580 scope.go:117] "RemoveContainer" containerID="f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563" Jul 03 19:13:15.958024 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.958004 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563"} err="failed to get container status \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": rpc error: code = NotFound desc = could not find container \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": container with ID starting with f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563 not found: ID does not exist" Jul 03 19:13:15.958090 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.958027 2580 scope.go:117] "RemoveContainer" containerID="847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa" Jul 03 19:13:15.958315 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.958293 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa"} err="failed to get container status \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": rpc error: code = NotFound desc = could not find container \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": container with ID starting with 847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa not found: ID does not exist" Jul 03 19:13:15.958393 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.958316 2580 scope.go:117] "RemoveContainer" containerID="d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454" Jul 03 19:13:15.958546 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.958528 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454"} err="failed to get container status \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": rpc error: code = NotFound desc = could not find container \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": container with ID starting with d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454 not found: ID does not exist" Jul 03 19:13:15.958634 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.958546 2580 scope.go:117] "RemoveContainer" containerID="6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf" Jul 03 19:13:15.958759 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.958737 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf"} err="failed to get container status \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": rpc error: code = NotFound desc = could not find container \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": container with ID starting with 6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf not found: ID does not exist" Jul 03 19:13:15.958802 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.958762 2580 scope.go:117] "RemoveContainer" containerID="014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4" Jul 03 19:13:15.959044 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959024 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4"} err="failed to get container status \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": rpc error: code = NotFound desc = could not find container \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": container with ID starting with 014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4 not found: ID does not exist" Jul 03 19:13:15.959116 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959045 2580 scope.go:117] "RemoveContainer" containerID="a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63" Jul 03 19:13:15.959334 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959174 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 03 19:13:15.959334 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959194 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 03 19:13:15.959334 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959206 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 03 19:13:15.959334 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959278 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 03 19:13:15.959542 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959209 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kwv6z\"" Jul 03 19:13:15.959542 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959383 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63"} err="failed to get container status \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": rpc error: code = NotFound desc = could not find container \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": container with ID starting with a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63 not found: ID does not exist" Jul 03 19:13:15.959542 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959403 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 03 19:13:15.959542 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959407 2580 scope.go:117] "RemoveContainer" containerID="5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71" Jul 03 19:13:15.959737 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959546 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1ihilftcg5bp6\"" Jul 03 19:13:15.959791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959735 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71"} err="failed to get container status \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": rpc error: code = NotFound desc = could not find container \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": container with ID starting with 5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71 not found: ID does not exist" Jul 03 19:13:15.959791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959756 2580 scope.go:117] "RemoveContainer" containerID="f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563" Jul 03 19:13:15.959884 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959799 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 03 19:13:15.959884 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.959819 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 03 19:13:15.960053 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.960037 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 03 19:13:15.960113 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.960063 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 03 19:13:15.960113 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.960084 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 03 19:13:15.960208 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.960119 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 03 19:13:15.960285 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.960208 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563"} err="failed to get container status \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": rpc error: code = NotFound desc = could not find container \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": container with ID starting with f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563 not found: ID does not exist" Jul 03 19:13:15.960285 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.960240 2580 scope.go:117] "RemoveContainer" containerID="847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa" Jul 03 19:13:15.960524 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.960502 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 03 19:13:15.960649 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.960598 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa"} err="failed to get container status \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": rpc error: code = NotFound desc = could not find container \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": container with ID starting with 847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa not found: ID does not exist" Jul 03 19:13:15.960649 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.960622 2580 scope.go:117] "RemoveContainer" containerID="d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454" Jul 03 19:13:15.960924 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.960902 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454"} err="failed to get container status \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": rpc error: code = NotFound desc = could not find container \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": container with ID starting with d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454 not found: ID does not exist" Jul 03 19:13:15.960924 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.960923 2580 scope.go:117] "RemoveContainer" containerID="6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf" Jul 03 19:13:15.961202 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.961179 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf"} err="failed to get container status \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": rpc error: code = NotFound desc = could not find container \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": container with ID starting with 6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf not found: ID does not exist" Jul 03 19:13:15.961311 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.961205 2580 scope.go:117] "RemoveContainer" containerID="014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4" Jul 03 19:13:15.961466 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.961443 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4"} err="failed to get container status \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": rpc error: code = NotFound desc = could not find container \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": container with ID starting with 014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4 not found: ID does not exist" Jul 03 19:13:15.961536 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.961469 2580 scope.go:117] "RemoveContainer" containerID="a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63" Jul 03 19:13:15.961745 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.961719 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63"} err="failed to get container status \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": rpc error: code = NotFound desc = could not find container \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": container with ID starting with a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63 not found: ID does not exist" Jul 03 19:13:15.961833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.961748 2580 scope.go:117] "RemoveContainer" containerID="5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71" Jul 03 19:13:15.962016 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.961994 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71"} err="failed to get container status \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": rpc error: code = NotFound desc = could not find container \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": container with ID starting with 5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71 not found: ID does not exist" Jul 03 19:13:15.962089 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.962017 2580 scope.go:117] "RemoveContainer" containerID="f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563" Jul 03 19:13:15.962295 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.962243 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563"} err="failed to get container status \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": rpc error: code = NotFound desc = could not find container \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": container with ID starting with f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563 not found: ID does not exist" Jul 03 19:13:15.962389 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.962297 2580 scope.go:117] "RemoveContainer" containerID="847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa" Jul 03 19:13:15.962442 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.962392 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 03 19:13:15.962596 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.962565 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa"} err="failed to get container status \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": rpc error: code = NotFound desc = could not find container \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": container with ID starting with 847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa not found: ID does not exist" Jul 03 19:13:15.962596 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.962595 2580 scope.go:117] "RemoveContainer" containerID="d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454" Jul 03 19:13:15.962864 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.962842 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454"} err="failed to get container status \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": rpc error: code = NotFound desc = could not find container \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": container with ID starting with d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454 not found: ID does not exist" Jul 03 19:13:15.962961 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.962865 2580 scope.go:117] "RemoveContainer" containerID="6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf" Jul 03 19:13:15.963160 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.963133 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf"} err="failed to get container status \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": rpc error: code = NotFound desc = could not find container \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": container with ID starting with 6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf not found: ID does not exist" Jul 03 19:13:15.963160 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.963160 2580 scope.go:117] "RemoveContainer" containerID="014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4" Jul 03 19:13:15.963487 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.963460 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4"} err="failed to get container status \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": rpc error: code = NotFound desc = could not find container \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": container with ID starting with 014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4 not found: ID does not exist" Jul 03 19:13:15.963487 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.963485 2580 scope.go:117] "RemoveContainer" containerID="a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63" Jul 03 19:13:15.963725 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.963707 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63"} err="failed to get container status \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": rpc error: code = NotFound desc = could not find container \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": container with ID starting with a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63 not found: ID does not exist" Jul 03 19:13:15.963788 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.963725 2580 scope.go:117] "RemoveContainer" containerID="5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71" Jul 03 19:13:15.964005 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.963976 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71"} err="failed to get container status \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": rpc error: code = NotFound desc = could not find container \"5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71\": container with ID starting with 5c1e74457e5ae817a9b6b1745fae62f0ed60dbb75084922830c41713bd4e9b71 not found: ID does not exist" Jul 03 19:13:15.964322 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.964006 2580 scope.go:117] "RemoveContainer" containerID="f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563" Jul 03 19:13:15.964396 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.964322 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563"} err="failed to get container status \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": rpc error: code = NotFound desc = could not find container \"f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563\": container with ID starting with f217bf6d1931297613096eac2189f5a5e368f12a87a8779ee4574cc153946563 not found: ID does not exist" Jul 03 19:13:15.964396 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.964347 2580 scope.go:117] "RemoveContainer" containerID="847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa" Jul 03 19:13:15.964738 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.964647 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa"} err="failed to get container status \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": rpc error: code = NotFound desc = could not find container \"847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa\": container with ID starting with 847733267c131617cf333022782af0bb512aeec213735253f2bb32b69f9ec0aa not found: ID does not exist" Jul 03 19:13:15.964738 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.964675 2580 scope.go:117] "RemoveContainer" containerID="d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454" Jul 03 19:13:15.965131 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.965108 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454"} err="failed to get container status \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": rpc error: code = NotFound desc = could not find container \"d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454\": container with ID starting with d1fa15b39403efe5b791d8ce9b2e11faf477ad6b15eb59e049a32b1c024f6454 not found: ID does not exist" Jul 03 19:13:15.965131 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.965129 2580 scope.go:117] "RemoveContainer" containerID="6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf" Jul 03 19:13:15.965290 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.965244 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 03 19:13:15.965383 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.965358 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf"} err="failed to get container status \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": rpc error: code = NotFound desc = could not find container \"6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf\": container with ID starting with 6c1961f2d4ad14768a8794a64451176b7dd7f9b6d670b36f41e07ea97f80ebdf not found: ID does not exist" Jul 03 19:13:15.965453 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.965385 2580 scope.go:117] "RemoveContainer" containerID="014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4" Jul 03 19:13:15.965604 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.965588 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4"} err="failed to get container status \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": rpc error: code = NotFound desc = could not find container \"014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4\": container with ID starting with 014cba608e47ac32355ac4e6c41086cbe4daed193f7888594a1916c737cdf3f4 not found: ID does not exist" Jul 03 19:13:15.965653 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.965605 2580 scope.go:117] "RemoveContainer" containerID="a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63" Jul 03 19:13:15.965826 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.965808 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63"} err="failed to get container status \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": rpc error: code = NotFound desc = could not find container \"a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63\": container with ID starting with a3ee6b80cc53ba20be7772ffb215dce7a8e2ba6c3daecd25562fc09cd93a5c63 not found: ID does not exist" Jul 03 19:13:15.975524 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.975489 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0396716-d475-4d7e-8929-14c69516f005-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976136 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976191 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976242 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-config\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0396716-d475-4d7e-8929-14c69516f005-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.976785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.977498 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976440 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.977498 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.977498 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.977498 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976521 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.977498 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976549 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.977498 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:15.977498 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:15.976615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9tvt\" (UniqueName: \"kubernetes.io/projected/f0396716-d475-4d7e-8929-14c69516f005-kube-api-access-v9tvt\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.077226 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.077226 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.077462 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077384 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.077462 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077421 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.077593 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.077794 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.077794 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.077794 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-config\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.077794 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.077794 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077760 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.077794 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0396716-d475-4d7e-8929-14c69516f005-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077924 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077968 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.077982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.078021 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.078032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.078111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.078166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9tvt\" (UniqueName: \"kubernetes.io/projected/f0396716-d475-4d7e-8929-14c69516f005-kube-api-access-v9tvt\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.078227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0396716-d475-4d7e-8929-14c69516f005-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.078422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.078332 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.079199 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.079173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.081046 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.080509 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.081046 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.080927 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.081046 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.080953 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.081046 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.081003 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.082052 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.082020 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.082768 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.082470 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0396716-d475-4d7e-8929-14c69516f005-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.082768 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.082713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.082926 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.082912 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.083743 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.083442 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0396716-d475-4d7e-8929-14c69516f005-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.083743 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.083699 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.083873 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.083832 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.084069 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.084039 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.084305 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.084288 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-config\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.084359 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.084308 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0396716-d475-4d7e-8929-14c69516f005-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.084931 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.084913 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0396716-d475-4d7e-8929-14c69516f005-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.087520 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.087500 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9tvt\" (UniqueName: \"kubernetes.io/projected/f0396716-d475-4d7e-8929-14c69516f005-kube-api-access-v9tvt\") pod \"prometheus-k8s-0\" (UID: \"f0396716-d475-4d7e-8929-14c69516f005\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.267391 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.267334 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:16.411247 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.411201 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 19:13:16.416327 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:13:16.416290 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0396716_d475_4d7e_8929_14c69516f005.slice/crio-88238087df02ad7e0fa0f87dd78a8cfa92594e2805eae079b7268559535e60fc WatchSource:0}: Error finding container 88238087df02ad7e0fa0f87dd78a8cfa92594e2805eae079b7268559535e60fc: Status 404 returned error can't find the container with id 88238087df02ad7e0fa0f87dd78a8cfa92594e2805eae079b7268559535e60fc Jul 03 19:13:16.904593 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.904554 2580 generic.go:356] "Generic (PLEG): container finished" podID="f0396716-d475-4d7e-8929-14c69516f005" containerID="08131e39f2731eec5f3a4589717e19c23c236a8483fc5668a118d7bf4700f315" exitCode=0 Jul 03 19:13:16.904777 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.904641 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0396716-d475-4d7e-8929-14c69516f005","Type":"ContainerDied","Data":"08131e39f2731eec5f3a4589717e19c23c236a8483fc5668a118d7bf4700f315"} Jul 03 19:13:16.904777 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:16.904710 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0396716-d475-4d7e-8929-14c69516f005","Type":"ContainerStarted","Data":"88238087df02ad7e0fa0f87dd78a8cfa92594e2805eae079b7268559535e60fc"} Jul 03 19:13:17.032929 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:17.032900 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092e06f8-31a1-47ea-8cb9-650559aeb303" path="/var/lib/kubelet/pods/092e06f8-31a1-47ea-8cb9-650559aeb303/volumes" Jul 03 19:13:17.916285 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:17.916237 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0396716-d475-4d7e-8929-14c69516f005","Type":"ContainerStarted","Data":"debeeb3fcaa7d1e09f5b31d3ce6b430a9bb73895b669ffb753936a1e3bf43602"} Jul 03 19:13:17.916484 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:17.916327 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0396716-d475-4d7e-8929-14c69516f005","Type":"ContainerStarted","Data":"2ac9372a1585d222d4f29c21afa03006bd343411220ab246c35e5e52cd234c41"} Jul 03 19:13:17.916484 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:17.916352 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0396716-d475-4d7e-8929-14c69516f005","Type":"ContainerStarted","Data":"930ab727f4850a0938f9f35440a3ebc0ec099225bf0cb7e7315098236b4b40be"} Jul 03 19:13:17.916484 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:17.916377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0396716-d475-4d7e-8929-14c69516f005","Type":"ContainerStarted","Data":"ba6dd78b50ddee4ce89fb3d53d690a770c03ebe61da6b7c30da47f3317cdcc17"} Jul 03 19:13:17.916484 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:17.916402 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0396716-d475-4d7e-8929-14c69516f005","Type":"ContainerStarted","Data":"1a823849a31b8bd3212ccde7c7db8f9bbf4754930b19507f720dfd08eaf06b3c"} Jul 03 19:13:17.916484 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:17.916424 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0396716-d475-4d7e-8929-14c69516f005","Type":"ContainerStarted","Data":"de13b9ed4f8a8092b28932c555ce3e11a4db1410012b78ebbf862913f60e0ea5"} Jul 03 19:13:17.945285 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:17.945198 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.923547713 podStartE2EDuration="2.945175026s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.627313ms" isStatefulPod=false podCreationTimestamp="2026-07-03 19:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:13:17.942863152 +0000 UTC m=+203.439162453" watchObservedRunningTime="2026-07-03 19:13:17.945175026 +0000 UTC m=+203.441474272" Jul 03 19:13:21.267645 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:21.267609 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:13:29.504899 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:29.504860 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b7f846c6b-7h86c"] Jul 03 19:13:54.529022 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.528972 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b7f846c6b-7h86c" podUID="28a955e8-422e-4da4-ae5f-6ba29e24c2d7" containerName="console" containerID="cri-o://978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760" gracePeriod=15 Jul 03 19:13:54.773785 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.773761 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:13:54.920122 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920097 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s29kt\" (UniqueName: \"kubernetes.io/projected/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-kube-api-access-s29kt\") pod \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " Jul 03 19:13:54.920234 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920130 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-oauth-serving-cert\") pod \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " Jul 03 19:13:54.920234 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920157 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-config\") pod \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " Jul 03 19:13:54.920234 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920222 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-service-ca\") pod \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " Jul 03 19:13:54.920364 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920283 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-oauth-config\") pod \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " Jul 03 19:13:54.920364 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920332 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-serving-cert\") pod \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " Jul 03 19:13:54.920452 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920386 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-trusted-ca-bundle\") pod \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\" (UID: \"28a955e8-422e-4da4-ae5f-6ba29e24c2d7\") " Jul 03 19:13:54.920727 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920560 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "28a955e8-422e-4da4-ae5f-6ba29e24c2d7" (UID: "28a955e8-422e-4da4-ae5f-6ba29e24c2d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:54.920727 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920597 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-config" (OuterVolumeSpecName: "console-config") pod "28a955e8-422e-4da4-ae5f-6ba29e24c2d7" (UID: "28a955e8-422e-4da4-ae5f-6ba29e24c2d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:54.920727 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920607 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "28a955e8-422e-4da4-ae5f-6ba29e24c2d7" (UID: "28a955e8-422e-4da4-ae5f-6ba29e24c2d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:54.920727 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920681 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-oauth-serving-cert\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:54.920978 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.920938 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "28a955e8-422e-4da4-ae5f-6ba29e24c2d7" (UID: "28a955e8-422e-4da4-ae5f-6ba29e24c2d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:54.922471 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.922444 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-kube-api-access-s29kt" (OuterVolumeSpecName: "kube-api-access-s29kt") pod "28a955e8-422e-4da4-ae5f-6ba29e24c2d7" (UID: "28a955e8-422e-4da4-ae5f-6ba29e24c2d7"). InnerVolumeSpecName "kube-api-access-s29kt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:13:54.922471 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.922447 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "28a955e8-422e-4da4-ae5f-6ba29e24c2d7" (UID: "28a955e8-422e-4da4-ae5f-6ba29e24c2d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:54.922596 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:54.922573 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "28a955e8-422e-4da4-ae5f-6ba29e24c2d7" (UID: "28a955e8-422e-4da4-ae5f-6ba29e24c2d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:55.021120 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.021091 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-serving-cert\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:55.021120 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.021115 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-trusted-ca-bundle\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:55.021363 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.021129 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s29kt\" (UniqueName: \"kubernetes.io/projected/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-kube-api-access-s29kt\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:55.021363 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.021140 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-config\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:55.021363 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.021148 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-service-ca\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:55.021363 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.021155 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28a955e8-422e-4da4-ae5f-6ba29e24c2d7-console-oauth-config\") on node \"ip-10-0-132-110.ec2.internal\" DevicePath \"\"" Jul 03 19:13:55.073160 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.073127 2580 generic.go:356] "Generic (PLEG): container finished" podID="28a955e8-422e-4da4-ae5f-6ba29e24c2d7" containerID="978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760" exitCode=0 Jul 03 19:13:55.073338 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.073175 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7f846c6b-7h86c" Jul 03 19:13:55.073338 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.073189 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7f846c6b-7h86c" event={"ID":"28a955e8-422e-4da4-ae5f-6ba29e24c2d7","Type":"ContainerDied","Data":"978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760"} Jul 03 19:13:55.073338 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.073249 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7f846c6b-7h86c" event={"ID":"28a955e8-422e-4da4-ae5f-6ba29e24c2d7","Type":"ContainerDied","Data":"70348abc043fd517ba9f4760a9d7b776cea199404e459def5ea8f614560d37df"} Jul 03 19:13:55.073338 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.073290 2580 scope.go:117] "RemoveContainer" containerID="978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760" Jul 03 19:13:55.081487 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.081464 2580 scope.go:117] "RemoveContainer" containerID="978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760" Jul 03 19:13:55.081710 ip-10-0-132-110 kubenswrapper[2580]: E0703 19:13:55.081693 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760\": container with ID starting with 978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760 not found: ID does not exist" containerID="978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760" Jul 03 19:13:55.081779 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.081730 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760"} err="failed to get container status \"978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760\": rpc error: code = NotFound desc = could not find container \"978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760\": container with ID starting with 978be667c18257e66cff158afdf90609efde5b50085c79074434cb4fe2f4c760 not found: ID does not exist" Jul 03 19:13:55.089145 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.089116 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b7f846c6b-7h86c"] Jul 03 19:13:55.091050 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:55.091029 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b7f846c6b-7h86c"] Jul 03 19:13:57.029853 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:13:57.029818 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28a955e8-422e-4da4-ae5f-6ba29e24c2d7" path="/var/lib/kubelet/pods/28a955e8-422e-4da4-ae5f-6ba29e24c2d7/volumes" Jul 03 19:14:16.268229 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:14:16.268195 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:14:16.283817 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:14:16.283786 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:14:17.178105 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:14:17.178071 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 19:14:54.899406 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:14:54.899376 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:14:54.906003 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:14:54.905975 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:14:54.910703 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:14:54.910682 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 03 19:16:30.404991 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.404951 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm"] Jul 03 19:16:30.405452 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.405272 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a955e8-422e-4da4-ae5f-6ba29e24c2d7" containerName="console" Jul 03 19:16:30.405452 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.405284 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a955e8-422e-4da4-ae5f-6ba29e24c2d7" containerName="console" Jul 03 19:16:30.405452 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.405337 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28a955e8-422e-4da4-ae5f-6ba29e24c2d7" containerName="console" Jul 03 19:16:30.408286 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.408252 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.410510 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.410480 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 03 19:16:30.410510 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.410479 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 03 19:16:30.410870 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.410822 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 03 19:16:30.410926 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.410862 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-km28h\"" Jul 03 19:16:30.411040 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.411028 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 03 19:16:30.434183 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.434161 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm"] Jul 03 19:16:30.539857 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.539826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9256195-5b31-4d9e-8259-8cc01190efdc-tmp\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.539983 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.539868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9256195-5b31-4d9e-8259-8cc01190efdc-manifests\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.539983 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.539892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9256195-5b31-4d9e-8259-8cc01190efdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.539983 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.539938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjmn9\" (UniqueName: \"kubernetes.io/projected/e9256195-5b31-4d9e-8259-8cc01190efdc-kube-api-access-rjmn9\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.540092 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.539997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9256195-5b31-4d9e-8259-8cc01190efdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.640623 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.640593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9256195-5b31-4d9e-8259-8cc01190efdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.640623 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.640625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjmn9\" (UniqueName: \"kubernetes.io/projected/e9256195-5b31-4d9e-8259-8cc01190efdc-kube-api-access-rjmn9\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.640777 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.640652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9256195-5b31-4d9e-8259-8cc01190efdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.640777 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.640746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9256195-5b31-4d9e-8259-8cc01190efdc-tmp\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.640842 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.640783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9256195-5b31-4d9e-8259-8cc01190efdc-manifests\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.641143 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.641117 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9256195-5b31-4d9e-8259-8cc01190efdc-manifests\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.643066 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.643043 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9256195-5b31-4d9e-8259-8cc01190efdc-tmp\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.643136 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.643061 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9256195-5b31-4d9e-8259-8cc01190efdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.643214 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.643198 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9256195-5b31-4d9e-8259-8cc01190efdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.650048 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.650022 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjmn9\" (UniqueName: \"kubernetes.io/projected/e9256195-5b31-4d9e-8259-8cc01190efdc-kube-api-access-rjmn9\") pod \"opendatahub-operator-controller-manager-5db468f498-896bm\" (UID: \"e9256195-5b31-4d9e-8259-8cc01190efdc\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.718488 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.718448 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:30.848321 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.848293 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm"] Jul 03 19:16:30.851218 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:16:30.851189 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9256195_5b31_4d9e_8259_8cc01190efdc.slice/crio-ed161e61ee054353c87af97f2e5a14caa630c6ec66fb67c4101067cd509136ac WatchSource:0}: Error finding container ed161e61ee054353c87af97f2e5a14caa630c6ec66fb67c4101067cd509136ac: Status 404 returned error can't find the container with id ed161e61ee054353c87af97f2e5a14caa630c6ec66fb67c4101067cd509136ac Jul 03 19:16:30.853109 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:30.853090 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 19:16:31.686305 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:31.686251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" event={"ID":"e9256195-5b31-4d9e-8259-8cc01190efdc","Type":"ContainerStarted","Data":"ed161e61ee054353c87af97f2e5a14caa630c6ec66fb67c4101067cd509136ac"} Jul 03 19:16:34.701214 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:34.701175 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" event={"ID":"e9256195-5b31-4d9e-8259-8cc01190efdc","Type":"ContainerStarted","Data":"f44eda42adf55ae2ce354bc4f0bee78386122a82b19555644dffbb18bf54ac49"} Jul 03 19:16:35.706187 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:35.706145 2580 generic.go:356] "Generic (PLEG): container finished" podID="e9256195-5b31-4d9e-8259-8cc01190efdc" containerID="f44eda42adf55ae2ce354bc4f0bee78386122a82b19555644dffbb18bf54ac49" exitCode=0 Jul 03 19:16:35.706570 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:35.706201 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" event={"ID":"e9256195-5b31-4d9e-8259-8cc01190efdc","Type":"ContainerDied","Data":"f44eda42adf55ae2ce354bc4f0bee78386122a82b19555644dffbb18bf54ac49"} Jul 03 19:16:36.711973 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:36.711943 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" event={"ID":"e9256195-5b31-4d9e-8259-8cc01190efdc","Type":"ContainerStarted","Data":"5183fd8df0817d30afb38a17e99fabbdcd602cf8b5adf8322394427b453be8dd"} Jul 03 19:16:36.712373 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:36.712048 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:36.732867 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:36.732822 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" podStartSLOduration=2.3539437579999998 podStartE2EDuration="6.732810228s" totalImagesPullingTime="3.311108919s" totalInitContainerRuntime="1.067757551s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:36.731757912 +0000 UTC m=+402.228057151" watchObservedRunningTime="2026-07-03 19:16:36.732810228 +0000 UTC m=+402.229109468" Jul 03 19:16:47.718558 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:47.718527 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-896bm" Jul 03 19:16:49.697449 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.697412 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v"] Jul 03 19:16:49.700865 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.700835 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.701231 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.701207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9lnz\" (UniqueName: \"kubernetes.io/projected/d8b0d560-7f49-44e4-bd3d-f3024640a198-kube-api-access-h9lnz\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.701357 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.701283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8b0d560-7f49-44e4-bd3d-f3024640a198-cert\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.701357 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.701320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d8b0d560-7f49-44e4-bd3d-f3024640a198-manager-config\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.701357 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.701344 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8b0d560-7f49-44e4-bd3d-f3024640a198-metrics-cert\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.704589 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.704567 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:16:49.705449 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.705433 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 03 19:16:49.705812 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.705795 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 03 19:16:49.705862 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.705821 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 03 19:16:49.705911 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.705865 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 03 19:16:49.706422 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.706403 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-48kph\"" Jul 03 19:16:49.727156 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.727133 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v"] Jul 03 19:16:49.802215 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.802182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lnz\" (UniqueName: \"kubernetes.io/projected/d8b0d560-7f49-44e4-bd3d-f3024640a198-kube-api-access-h9lnz\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.802420 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.802236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8b0d560-7f49-44e4-bd3d-f3024640a198-cert\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.802420 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.802290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d8b0d560-7f49-44e4-bd3d-f3024640a198-manager-config\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.802420 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.802313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8b0d560-7f49-44e4-bd3d-f3024640a198-metrics-cert\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.803028 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.803009 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d8b0d560-7f49-44e4-bd3d-f3024640a198-manager-config\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.804678 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.804653 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8b0d560-7f49-44e4-bd3d-f3024640a198-metrics-cert\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.804764 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.804710 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8b0d560-7f49-44e4-bd3d-f3024640a198-cert\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.814603 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.814581 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9lnz\" (UniqueName: \"kubernetes.io/projected/d8b0d560-7f49-44e4-bd3d-f3024640a198-kube-api-access-h9lnz\") pod \"lws-controller-manager-569d79d5df-8zf8v\" (UID: \"d8b0d560-7f49-44e4-bd3d-f3024640a198\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:49.951322 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.951241 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-994f4989b-tmhqs"] Jul 03 19:16:49.954654 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.954640 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" Jul 03 19:16:49.957506 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.957484 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 03 19:16:49.957684 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.957670 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lwfxl\"" Jul 03 19:16:49.957745 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.957704 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 03 19:16:49.965326 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:49.965306 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-994f4989b-tmhqs"] Jul 03 19:16:50.004008 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.003979 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/604bf439-5695-43a2-9bd2-26300ee7a20f-tls-certs\") pod \"kube-auth-proxy-994f4989b-tmhqs\" (UID: \"604bf439-5695-43a2-9bd2-26300ee7a20f\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" Jul 03 19:16:50.004008 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.004009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/604bf439-5695-43a2-9bd2-26300ee7a20f-tmp\") pod \"kube-auth-proxy-994f4989b-tmhqs\" (UID: \"604bf439-5695-43a2-9bd2-26300ee7a20f\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" Jul 03 19:16:50.004178 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.004028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxphz\" (UniqueName: \"kubernetes.io/projected/604bf439-5695-43a2-9bd2-26300ee7a20f-kube-api-access-jxphz\") pod \"kube-auth-proxy-994f4989b-tmhqs\" (UID: \"604bf439-5695-43a2-9bd2-26300ee7a20f\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" Jul 03 19:16:50.010383 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.010361 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:50.104967 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.104935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/604bf439-5695-43a2-9bd2-26300ee7a20f-tls-certs\") pod \"kube-auth-proxy-994f4989b-tmhqs\" (UID: \"604bf439-5695-43a2-9bd2-26300ee7a20f\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" Jul 03 19:16:50.105090 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.104984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/604bf439-5695-43a2-9bd2-26300ee7a20f-tmp\") pod \"kube-auth-proxy-994f4989b-tmhqs\" (UID: \"604bf439-5695-43a2-9bd2-26300ee7a20f\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" Jul 03 19:16:50.105090 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.105013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxphz\" (UniqueName: \"kubernetes.io/projected/604bf439-5695-43a2-9bd2-26300ee7a20f-kube-api-access-jxphz\") pod \"kube-auth-proxy-994f4989b-tmhqs\" (UID: \"604bf439-5695-43a2-9bd2-26300ee7a20f\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" Jul 03 19:16:50.114014 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.113981 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxphz\" (UniqueName: \"kubernetes.io/projected/604bf439-5695-43a2-9bd2-26300ee7a20f-kube-api-access-jxphz\") pod \"kube-auth-proxy-994f4989b-tmhqs\" (UID: \"604bf439-5695-43a2-9bd2-26300ee7a20f\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" Jul 03 19:16:50.118406 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.118371 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/604bf439-5695-43a2-9bd2-26300ee7a20f-tmp\") pod \"kube-auth-proxy-994f4989b-tmhqs\" (UID: \"604bf439-5695-43a2-9bd2-26300ee7a20f\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" Jul 03 19:16:50.119876 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.119854 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/604bf439-5695-43a2-9bd2-26300ee7a20f-tls-certs\") pod \"kube-auth-proxy-994f4989b-tmhqs\" (UID: \"604bf439-5695-43a2-9bd2-26300ee7a20f\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" Jul 03 19:16:50.141340 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.141318 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v"] Jul 03 19:16:50.143845 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:16:50.143825 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b0d560_7f49_44e4_bd3d_f3024640a198.slice/crio-c42af3ca5fb54260e15f06d75023a66ec72ced5a676664500364c17ded4399a0 WatchSource:0}: Error finding container c42af3ca5fb54260e15f06d75023a66ec72ced5a676664500364c17ded4399a0: Status 404 returned error can't find the container with id c42af3ca5fb54260e15f06d75023a66ec72ced5a676664500364c17ded4399a0 Jul 03 19:16:50.264963 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.264874 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" Jul 03 19:16:50.399128 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.399076 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-994f4989b-tmhqs"] Jul 03 19:16:50.401617 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:16:50.401592 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604bf439_5695_43a2_9bd2_26300ee7a20f.slice/crio-1444f8d700b3871fd5c1b71ef487d3fc6625807c38940a2a75ba94c218efae5b WatchSource:0}: Error finding container 1444f8d700b3871fd5c1b71ef487d3fc6625807c38940a2a75ba94c218efae5b: Status 404 returned error can't find the container with id 1444f8d700b3871fd5c1b71ef487d3fc6625807c38940a2a75ba94c218efae5b Jul 03 19:16:50.773164 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.773133 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" event={"ID":"604bf439-5695-43a2-9bd2-26300ee7a20f","Type":"ContainerStarted","Data":"1444f8d700b3871fd5c1b71ef487d3fc6625807c38940a2a75ba94c218efae5b"} Jul 03 19:16:50.774220 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:50.774196 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" event={"ID":"d8b0d560-7f49-44e4-bd3d-f3024640a198","Type":"ContainerStarted","Data":"c42af3ca5fb54260e15f06d75023a66ec72ced5a676664500364c17ded4399a0"} Jul 03 19:16:53.792319 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:53.792257 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" event={"ID":"d8b0d560-7f49-44e4-bd3d-f3024640a198","Type":"ContainerStarted","Data":"823b7c86df250193ae2eb9d8ef86e802e30cf685098370338e82c5df71d96c2b"} Jul 03 19:16:53.792851 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:53.792344 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:16:53.793821 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:53.793800 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" event={"ID":"604bf439-5695-43a2-9bd2-26300ee7a20f","Type":"ContainerStarted","Data":"e6c78964d289ae2d07a1b5edeb79a7d19860cb77635646b17e7243801e096227"} Jul 03 19:16:53.808530 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:53.808476 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" podStartSLOduration=1.377313971 podStartE2EDuration="4.808456774s" totalImagesPullingTime="3.431142803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:53.808288775 +0000 UTC m=+419.304588016" watchObservedRunningTime="2026-07-03 19:16:53.808456774 +0000 UTC m=+419.304756017" Jul 03 19:16:53.823049 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:16:53.823001 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-994f4989b-tmhqs" podStartSLOduration=1.647617227 podStartE2EDuration="4.822987045s" totalImagesPullingTime="3.175369818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:53.821992568 +0000 UTC m=+419.318291809" watchObservedRunningTime="2026-07-03 19:16:53.822987045 +0000 UTC m=+419.319286285" Jul 03 19:17:04.800330 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:17:04.800303 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-8zf8v" Jul 03 19:18:33.860640 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:33.860602 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz"] Jul 03 19:18:33.864046 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:33.864025 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" Jul 03 19:18:33.866175 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:33.866152 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 03 19:18:33.866423 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:33.866407 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 03 19:18:33.867068 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:33.867052 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4g74m\"" Jul 03 19:18:33.867148 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:33.867093 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 03 19:18:33.867201 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:33.867145 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 03 19:18:33.870230 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:33.870208 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz"] Jul 03 19:18:33.921752 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:33.921710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d275a524-cf53-4335-92af-8a5046abe59b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mtghz\" (UID: \"d275a524-cf53-4335-92af-8a5046abe59b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" Jul 03 19:18:33.921752 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:33.921752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6q2n\" (UniqueName: \"kubernetes.io/projected/d275a524-cf53-4335-92af-8a5046abe59b-kube-api-access-b6q2n\") pod \"kuadrant-console-plugin-66b5774985-mtghz\" (UID: \"d275a524-cf53-4335-92af-8a5046abe59b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" Jul 03 19:18:33.921961 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:33.921791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d275a524-cf53-4335-92af-8a5046abe59b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mtghz\" (UID: \"d275a524-cf53-4335-92af-8a5046abe59b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" Jul 03 19:18:34.022480 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.022446 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d275a524-cf53-4335-92af-8a5046abe59b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mtghz\" (UID: \"d275a524-cf53-4335-92af-8a5046abe59b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" Jul 03 19:18:34.022480 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.022482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6q2n\" (UniqueName: \"kubernetes.io/projected/d275a524-cf53-4335-92af-8a5046abe59b-kube-api-access-b6q2n\") pod \"kuadrant-console-plugin-66b5774985-mtghz\" (UID: \"d275a524-cf53-4335-92af-8a5046abe59b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" Jul 03 19:18:34.022677 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.022528 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d275a524-cf53-4335-92af-8a5046abe59b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mtghz\" (UID: \"d275a524-cf53-4335-92af-8a5046abe59b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" Jul 03 19:18:34.023219 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.023187 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d275a524-cf53-4335-92af-8a5046abe59b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mtghz\" (UID: \"d275a524-cf53-4335-92af-8a5046abe59b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" Jul 03 19:18:34.024948 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.024926 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d275a524-cf53-4335-92af-8a5046abe59b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mtghz\" (UID: \"d275a524-cf53-4335-92af-8a5046abe59b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" Jul 03 19:18:34.030828 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.030807 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6q2n\" (UniqueName: \"kubernetes.io/projected/d275a524-cf53-4335-92af-8a5046abe59b-kube-api-access-b6q2n\") pod \"kuadrant-console-plugin-66b5774985-mtghz\" (UID: \"d275a524-cf53-4335-92af-8a5046abe59b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" Jul 03 19:18:34.185745 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.185703 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" Jul 03 19:18:34.314321 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.314297 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz"] Jul 03 19:18:34.317140 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:18:34.317097 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd275a524_cf53_4335_92af_8a5046abe59b.slice/crio-b452f81d1e695eb7c528e0a4e6c75caf0d05693b63fcdd3b656a72b88e696d42 WatchSource:0}: Error finding container b452f81d1e695eb7c528e0a4e6c75caf0d05693b63fcdd3b656a72b88e696d42: Status 404 returned error can't find the container with id b452f81d1e695eb7c528e0a4e6c75caf0d05693b63fcdd3b656a72b88e696d42 Jul 03 19:18:34.499703 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.499618 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd"] Jul 03 19:18:34.504095 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.504079 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd" Jul 03 19:18:34.506526 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.506504 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mqg5l\"" Jul 03 19:18:34.506645 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.506505 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 03 19:18:34.513418 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.513396 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd"] Jul 03 19:18:34.528377 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.528343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcqk7\" (UniqueName: \"kubernetes.io/projected/7f4ed978-7df8-4087-934a-81f33111692d-kube-api-access-wcqk7\") pod \"dns-operator-controller-manager-864dd78c4c-mblwd\" (UID: \"7f4ed978-7df8-4087-934a-81f33111692d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd" Jul 03 19:18:34.629844 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.629808 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcqk7\" (UniqueName: \"kubernetes.io/projected/7f4ed978-7df8-4087-934a-81f33111692d-kube-api-access-wcqk7\") pod \"dns-operator-controller-manager-864dd78c4c-mblwd\" (UID: \"7f4ed978-7df8-4087-934a-81f33111692d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd" Jul 03 19:18:34.639380 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.639354 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcqk7\" (UniqueName: \"kubernetes.io/projected/7f4ed978-7df8-4087-934a-81f33111692d-kube-api-access-wcqk7\") pod \"dns-operator-controller-manager-864dd78c4c-mblwd\" (UID: \"7f4ed978-7df8-4087-934a-81f33111692d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd" Jul 03 19:18:34.816394 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.816319 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd" Jul 03 19:18:34.941515 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:34.941491 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd"] Jul 03 19:18:34.943909 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:18:34.943885 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4ed978_7df8_4087_934a_81f33111692d.slice/crio-bffa92d42a1231103d07edb2dfa73619ce50a3b4841004758aa89a1007d7e9f9 WatchSource:0}: Error finding container bffa92d42a1231103d07edb2dfa73619ce50a3b4841004758aa89a1007d7e9f9: Status 404 returned error can't find the container with id bffa92d42a1231103d07edb2dfa73619ce50a3b4841004758aa89a1007d7e9f9 Jul 03 19:18:35.233236 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:35.233197 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd" event={"ID":"7f4ed978-7df8-4087-934a-81f33111692d","Type":"ContainerStarted","Data":"bffa92d42a1231103d07edb2dfa73619ce50a3b4841004758aa89a1007d7e9f9"} Jul 03 19:18:35.234477 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:35.234450 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" event={"ID":"d275a524-cf53-4335-92af-8a5046abe59b","Type":"ContainerStarted","Data":"b452f81d1e695eb7c528e0a4e6c75caf0d05693b63fcdd3b656a72b88e696d42"} Jul 03 19:18:38.255126 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:38.255082 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd" event={"ID":"7f4ed978-7df8-4087-934a-81f33111692d","Type":"ContainerStarted","Data":"d6ec520bcc5f5eec25b94a8249c27ea7d470b51ad9df8827fccde2b2f9f0be7b"} Jul 03 19:18:38.255621 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:38.255242 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd" Jul 03 19:18:38.271402 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:38.271341 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd" podStartSLOduration=1.7835984520000001 podStartE2EDuration="4.27132178s" totalImagesPullingTime="2.487723328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:18:38.269976095 +0000 UTC m=+523.766275364" watchObservedRunningTime="2026-07-03 19:18:38.27132178 +0000 UTC m=+523.767621023" Jul 03 19:18:44.523054 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:44.523000 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c"] Jul 03 19:18:44.547052 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:44.547014 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c"] Jul 03 19:18:44.547239 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:44.547195 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" Jul 03 19:18:44.549772 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:44.549743 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-97v6x\"" Jul 03 19:18:44.628114 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:44.628059 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/828391d3-a7b0-4e2f-b36a-1442e04b51aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pk88c\" (UID: \"828391d3-a7b0-4e2f-b36a-1442e04b51aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" Jul 03 19:18:44.628320 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:44.628235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdr6w\" (UniqueName: \"kubernetes.io/projected/828391d3-a7b0-4e2f-b36a-1442e04b51aa-kube-api-access-qdr6w\") pod \"kuadrant-operator-controller-manager-86878c769f-pk88c\" (UID: \"828391d3-a7b0-4e2f-b36a-1442e04b51aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" Jul 03 19:18:44.729491 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:44.729447 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdr6w\" (UniqueName: \"kubernetes.io/projected/828391d3-a7b0-4e2f-b36a-1442e04b51aa-kube-api-access-qdr6w\") pod \"kuadrant-operator-controller-manager-86878c769f-pk88c\" (UID: \"828391d3-a7b0-4e2f-b36a-1442e04b51aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" Jul 03 19:18:44.729679 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:44.729554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/828391d3-a7b0-4e2f-b36a-1442e04b51aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pk88c\" (UID: \"828391d3-a7b0-4e2f-b36a-1442e04b51aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" Jul 03 19:18:44.729953 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:44.729932 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/828391d3-a7b0-4e2f-b36a-1442e04b51aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pk88c\" (UID: \"828391d3-a7b0-4e2f-b36a-1442e04b51aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" Jul 03 19:18:44.738198 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:44.738172 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdr6w\" (UniqueName: \"kubernetes.io/projected/828391d3-a7b0-4e2f-b36a-1442e04b51aa-kube-api-access-qdr6w\") pod \"kuadrant-operator-controller-manager-86878c769f-pk88c\" (UID: \"828391d3-a7b0-4e2f-b36a-1442e04b51aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" Jul 03 19:18:44.862029 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:44.861935 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" Jul 03 19:18:49.263406 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:49.263323 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mblwd" Jul 03 19:18:55.930226 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:55.930200 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c"] Jul 03 19:18:55.936469 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:18:55.936441 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828391d3_a7b0_4e2f_b36a_1442e04b51aa.slice/crio-3ab5c79082fe3ad2d94f1d62a2e9a93ae9b6efea156fd7c062fcd2c521af3e42 WatchSource:0}: Error finding container 3ab5c79082fe3ad2d94f1d62a2e9a93ae9b6efea156fd7c062fcd2c521af3e42: Status 404 returned error can't find the container with id 3ab5c79082fe3ad2d94f1d62a2e9a93ae9b6efea156fd7c062fcd2c521af3e42 Jul 03 19:18:56.353967 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:56.353925 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" event={"ID":"d275a524-cf53-4335-92af-8a5046abe59b","Type":"ContainerStarted","Data":"4763212cb4443b56219d285440b15d18abb99d18b2665ae421d6c60665e21927"} Jul 03 19:18:56.355164 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:56.355134 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" event={"ID":"828391d3-a7b0-4e2f-b36a-1442e04b51aa","Type":"ContainerStarted","Data":"3ab5c79082fe3ad2d94f1d62a2e9a93ae9b6efea156fd7c062fcd2c521af3e42"} Jul 03 19:18:56.369194 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:18:56.369141 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mtghz" podStartSLOduration=1.7955179110000001 podStartE2EDuration="23.36912205s" totalImagesPullingTime="21.573604139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:18:56.367003706 +0000 UTC m=+541.863302959" watchObservedRunningTime="2026-07-03 19:18:56.36912205 +0000 UTC m=+541.865421299" Jul 03 19:19:02.388434 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:19:02.388390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" event={"ID":"828391d3-a7b0-4e2f-b36a-1442e04b51aa","Type":"ContainerStarted","Data":"32d86733e47427bf5e82a1889e8c09f2323f51908e290bb795008500278a4eb4"} Jul 03 19:19:02.388895 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:19:02.388486 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" Jul 03 19:19:02.408238 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:19:02.408185 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" podStartSLOduration=12.128566346 podStartE2EDuration="18.408168569s" totalImagesPullingTime="6.279602223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:19:02.40683282 +0000 UTC m=+547.903132081" watchObservedRunningTime="2026-07-03 19:19:02.408168569 +0000 UTC m=+547.904467813" Jul 03 19:19:13.396293 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:19:13.396230 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pk88c" Jul 03 19:19:54.929943 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:19:54.929916 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:19:54.933499 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:19:54.933476 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:21:56.942643 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:56.942561 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r"] Jul 03 19:21:56.946114 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:56.946092 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:56.948715 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:56.948691 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-79k5p\"" Jul 03 19:21:56.948848 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:56.948742 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 03 19:21:56.949611 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:56.949586 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 03 19:21:56.949611 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:56.949601 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 03 19:21:56.958249 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:56.958224 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r"] Jul 03 19:21:57.042788 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.042753 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.042788 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.042789 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.043009 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.042830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.043009 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.042855 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.043009 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.042911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tzwc\" (UniqueName: \"kubernetes.io/projected/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-kube-api-access-6tzwc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.043009 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.042950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.144372 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.144338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.144551 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.144382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.144551 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.144433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.144551 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.144460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.144551 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.144500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tzwc\" (UniqueName: \"kubernetes.io/projected/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-kube-api-access-6tzwc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.144551 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.144536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.144820 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.144681 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.144884 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.144817 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.145041 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.145021 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.146671 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.146649 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.146901 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.146883 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.152544 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.152519 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tzwc\" (UniqueName: \"kubernetes.io/projected/8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e-kube-api-access-6tzwc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4gt5r\" (UID: \"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.257637 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.257560 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:21:57.390913 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.390874 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r"] Jul 03 19:21:57.394952 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:21:57.394922 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc97726_8c1a_4dd2_bfe8_c5ba7177a88e.slice/crio-0f6e5655af6698684f390321db56986e40fb842fe44b4f07bf9aac55fb11c0f4 WatchSource:0}: Error finding container 0f6e5655af6698684f390321db56986e40fb842fe44b4f07bf9aac55fb11c0f4: Status 404 returned error can't find the container with id 0f6e5655af6698684f390321db56986e40fb842fe44b4f07bf9aac55fb11c0f4 Jul 03 19:21:57.396274 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:57.396245 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 19:21:58.176523 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:58.176475 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" event={"ID":"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e","Type":"ContainerStarted","Data":"0f6e5655af6698684f390321db56986e40fb842fe44b4f07bf9aac55fb11c0f4"} Jul 03 19:21:59.182507 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:59.182475 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" event={"ID":"8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e","Type":"ContainerStarted","Data":"dbc0908158def52f06b82b023149552f6079e3b9a9daa174eb1416858661d3bc"} Jul 03 19:21:59.199348 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:21:59.199240 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" podStartSLOduration=2.2219925959999998 podStartE2EDuration="3.199227081s" totalImagesPullingTime="977.234485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:21:59.197799068 +0000 UTC m=+724.694098326" watchObservedRunningTime="2026-07-03 19:21:59.199227081 +0000 UTC m=+724.695526322" Jul 03 19:22:07.258603 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:07.258562 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:22:07.259165 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:07.258832 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:22:07.271306 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:07.271277 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:22:08.242685 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:08.242651 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4gt5r" Jul 03 19:22:12.148088 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.148055 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq"] Jul 03 19:22:12.152087 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.152065 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.154332 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.154315 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 03 19:22:12.162573 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.162550 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq"] Jul 03 19:22:12.175045 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.174899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhrzm\" (UniqueName: \"kubernetes.io/projected/5e1537af-5874-47c0-a8c4-11056ef9df3c-kube-api-access-lhrzm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.175045 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.174953 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1537af-5874-47c0-a8c4-11056ef9df3c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.175371 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.175054 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.175371 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.175082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.175371 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.175125 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.175371 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.175191 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.275705 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.275665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.275705 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.275707 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.275943 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.275733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.275943 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.275765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.275943 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.275820 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhrzm\" (UniqueName: \"kubernetes.io/projected/5e1537af-5874-47c0-a8c4-11056ef9df3c-kube-api-access-lhrzm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.275943 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.275850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1537af-5874-47c0-a8c4-11056ef9df3c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.276151 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.276125 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.276207 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.276152 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.276247 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.276204 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.278118 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.278095 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e1537af-5874-47c0-a8c4-11056ef9df3c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.278384 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.278363 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1537af-5874-47c0-a8c4-11056ef9df3c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.283791 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.283772 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhrzm\" (UniqueName: \"kubernetes.io/projected/5e1537af-5874-47c0-a8c4-11056ef9df3c-kube-api-access-lhrzm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twwtq\" (UID: \"5e1537af-5874-47c0-a8c4-11056ef9df3c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.463133 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.463097 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:12.595958 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:12.595918 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq"] Jul 03 19:22:12.598620 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:22:12.598590 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1537af_5874_47c0_a8c4_11056ef9df3c.slice/crio-b6e6bfcfd69bbfd50d8f744d5c9f737c00d2307fc223bf9b24885a8abcaef398 WatchSource:0}: Error finding container b6e6bfcfd69bbfd50d8f744d5c9f737c00d2307fc223bf9b24885a8abcaef398: Status 404 returned error can't find the container with id b6e6bfcfd69bbfd50d8f744d5c9f737c00d2307fc223bf9b24885a8abcaef398 Jul 03 19:22:13.257162 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:13.257124 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" event={"ID":"5e1537af-5874-47c0-a8c4-11056ef9df3c","Type":"ContainerStarted","Data":"205db8d3cfafd5aaf3ec3044931ccfdd1505a0c04fa2d74f6160aca78e573bdd"} Jul 03 19:22:13.257588 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:13.257176 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" event={"ID":"5e1537af-5874-47c0-a8c4-11056ef9df3c","Type":"ContainerStarted","Data":"b6e6bfcfd69bbfd50d8f744d5c9f737c00d2307fc223bf9b24885a8abcaef398"} Jul 03 19:22:13.271990 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:13.271945 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" podStartSLOduration=1.097709532 podStartE2EDuration="1.271930767s" totalImagesPullingTime="174.221235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:22:13.271202147 +0000 UTC m=+738.767501390" watchObservedRunningTime="2026-07-03 19:22:13.271930767 +0000 UTC m=+738.768230007" Jul 03 19:22:22.464317 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:22.464257 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:22.464678 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:22.464344 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:22.476780 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:22.476754 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:22:23.317053 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:22:23.317020 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twwtq" Jul 03 19:24:54.959625 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:24:54.959538 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:24:54.960758 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:24:54.960738 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:29:54.989997 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:29:54.989966 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:29:54.991544 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:29:54.991524 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:34:55.019769 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:34:55.019741 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:34:55.022395 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:34:55.022022 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:35:22.727899 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:22.727864 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-896bm_e9256195-5b31-4d9e-8259-8cc01190efdc/manager/0.log" Jul 03 19:35:22.733844 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:22.733823 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-896bm_e9256195-5b31-4d9e-8259-8cc01190efdc/copy-manifests/0.log" Jul 03 19:35:24.456195 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:24.456163 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mblwd_7f4ed978-7df8-4087-934a-81f33111692d/manager/0.log" Jul 03 19:35:24.565052 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:24.565024 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mtghz_d275a524-cf53-4335-92af-8a5046abe59b/kuadrant-console-plugin/0.log" Jul 03 19:35:24.808972 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:24.808893 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pk88c_828391d3-a7b0-4e2f-b36a-1442e04b51aa/manager/0.log" Jul 03 19:35:25.735828 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:25.735796 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-994f4989b-tmhqs_604bf439-5695-43a2-9bd2-26300ee7a20f/kube-auth-proxy/0.log" Jul 03 19:35:26.219342 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:26.219314 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b8b6fffc9-ks2dx_07a6fca2-14ed-4971-aa93-2f928fbfcf7c/router/0.log" Jul 03 19:35:26.771816 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:26.771788 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4gt5r_8fc97726-8c1a-4dd2-bfe8-c5ba7177a88e/main/0.log" Jul 03 19:35:26.981811 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:26.981786 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-twwtq_5e1537af-5874-47c0-a8c4-11056ef9df3c/main/0.log" Jul 03 19:35:34.454556 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:34.454521 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xhjjv_48da5a1e-f8a6-476c-b815-f0388f0ebb67/global-pull-secret-syncer/0.log" Jul 03 19:35:34.560602 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:34.560572 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qlbwl_ffefdb25-0ec3-4dda-9d05-df25861106dc/konnectivity-agent/0.log" Jul 03 19:35:34.620858 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:34.620820 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-110.ec2.internal_eeb56b029090ca0ee8dbd6a71a52c6ad/haproxy/0.log" Jul 03 19:35:39.810869 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:39.810841 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mblwd_7f4ed978-7df8-4087-934a-81f33111692d/manager/0.log" Jul 03 19:35:39.835051 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:39.835027 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mtghz_d275a524-cf53-4335-92af-8a5046abe59b/kuadrant-console-plugin/0.log" Jul 03 19:35:39.950310 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:39.950281 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pk88c_828391d3-a7b0-4e2f-b36a-1442e04b51aa/manager/0.log" Jul 03 19:35:42.012506 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.012283 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5c95549cdc-vx7zt_e435da54-0820-4091-a6f7-ad9c6d1d8117/metrics-server/0.log" Jul 03 19:35:42.042743 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.042718 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-jz5sj_4ca6406c-be28-4e49-bf5a-f785be2b8a3b/monitoring-plugin/0.log" Jul 03 19:35:42.156376 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.156350 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqh7p_2b94c983-5280-49c3-b398-e272cea12c00/node-exporter/0.log" Jul 03 19:35:42.173460 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.173418 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqh7p_2b94c983-5280-49c3-b398-e272cea12c00/kube-rbac-proxy/0.log" Jul 03 19:35:42.202421 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.202397 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqh7p_2b94c983-5280-49c3-b398-e272cea12c00/init-textfile/0.log" Jul 03 19:35:42.400739 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.400665 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0396716-d475-4d7e-8929-14c69516f005/prometheus/0.log" Jul 03 19:35:42.427000 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.426980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0396716-d475-4d7e-8929-14c69516f005/config-reloader/0.log" Jul 03 19:35:42.451604 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.451582 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0396716-d475-4d7e-8929-14c69516f005/thanos-sidecar/0.log" Jul 03 19:35:42.470379 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.470359 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0396716-d475-4d7e-8929-14c69516f005/kube-rbac-proxy-web/0.log" Jul 03 19:35:42.494518 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.494501 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0396716-d475-4d7e-8929-14c69516f005/kube-rbac-proxy/0.log" Jul 03 19:35:42.519112 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.519093 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0396716-d475-4d7e-8929-14c69516f005/kube-rbac-proxy-thanos/0.log" Jul 03 19:35:42.542573 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.542556 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0396716-d475-4d7e-8929-14c69516f005/init-config-reloader/0.log" Jul 03 19:35:42.571807 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.571785 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-8qbjg_72160ddf-0d9c-486d-8418-62947203e91d/prometheus-operator/0.log" Jul 03 19:35:42.587179 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.587163 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-8qbjg_72160ddf-0d9c-486d-8418-62947203e91d/kube-rbac-proxy/0.log" Jul 03 19:35:42.611138 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.611114 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-fbf5d_f9941546-fcd6-4c5a-8cec-08e9f0060cd2/prometheus-operator-admission-webhook/0.log" Jul 03 19:35:42.723436 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.723414 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7644bff745-97fm7_689fbc04-4e11-40e3-88ec-f6c822508b6d/thanos-query/0.log" Jul 03 19:35:42.743833 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.743802 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7644bff745-97fm7_689fbc04-4e11-40e3-88ec-f6c822508b6d/kube-rbac-proxy-web/0.log" Jul 03 19:35:42.762665 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.762648 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7644bff745-97fm7_689fbc04-4e11-40e3-88ec-f6c822508b6d/kube-rbac-proxy/0.log" Jul 03 19:35:42.781350 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.781334 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7644bff745-97fm7_689fbc04-4e11-40e3-88ec-f6c822508b6d/prom-label-proxy/0.log" Jul 03 19:35:42.799502 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.799481 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7644bff745-97fm7_689fbc04-4e11-40e3-88ec-f6c822508b6d/kube-rbac-proxy-rules/0.log" Jul 03 19:35:42.819773 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:42.819755 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7644bff745-97fm7_689fbc04-4e11-40e3-88ec-f6c822508b6d/kube-rbac-proxy-metrics/0.log" Jul 03 19:35:44.084021 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:44.083982 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-r2p6s_ea0ff22d-d38b-41b9-89be-42761dcddc93/networking-console-plugin/0.log" Jul 03 19:35:44.682969 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:44.682939 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/1.log" Jul 03 19:35:44.691964 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:44.691937 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nthgs_6929e3c8-865f-456c-8d1e-061a213fad05/console-operator/2.log" Jul 03 19:35:45.097757 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.097683 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9"] Jul 03 19:35:45.101328 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.101306 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.103565 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.103545 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9kmg\"/\"openshift-service-ca.crt\"" Jul 03 19:35:45.104439 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.104419 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c9kmg\"/\"default-dockercfg-gjmpz\"" Jul 03 19:35:45.104538 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.104460 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9kmg\"/\"kube-root-ca.crt\"" Jul 03 19:35:45.110228 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.110203 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9"] Jul 03 19:35:45.191830 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.191801 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-podres\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.191928 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.191834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwvj8\" (UniqueName: \"kubernetes.io/projected/623c2240-a8e1-4936-917f-89715e46192b-kube-api-access-pwvj8\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.191928 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.191856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-lib-modules\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.191995 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.191947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-sys\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.192028 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.192002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-proc\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.293230 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.293203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-sys\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.293344 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.293248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-proc\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.293344 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.293311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-podres\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.293344 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.293328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwvj8\" (UniqueName: \"kubernetes.io/projected/623c2240-a8e1-4936-917f-89715e46192b-kube-api-access-pwvj8\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.293471 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.293350 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-lib-modules\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.293471 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.293356 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-proc\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.293471 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.293329 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-sys\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.293471 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.293451 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-podres\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.293619 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.293498 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/623c2240-a8e1-4936-917f-89715e46192b-lib-modules\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.299909 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.299891 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwvj8\" (UniqueName: \"kubernetes.io/projected/623c2240-a8e1-4936-917f-89715e46192b-kube-api-access-pwvj8\") pod \"perf-node-gather-daemonset-gpcc9\" (UID: \"623c2240-a8e1-4936-917f-89715e46192b\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.411918 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.411848 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:45.538149 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.538125 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9"] Jul 03 19:35:45.540116 ip-10-0-132-110 kubenswrapper[2580]: W0703 19:35:45.540091 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod623c2240_a8e1_4936_917f_89715e46192b.slice/crio-0786f192c98051fb9376092961d1c44fde50ccba5c58be372d43bb7944113277 WatchSource:0}: Error finding container 0786f192c98051fb9376092961d1c44fde50ccba5c58be372d43bb7944113277: Status 404 returned error can't find the container with id 0786f192c98051fb9376092961d1c44fde50ccba5c58be372d43bb7944113277 Jul 03 19:35:45.973455 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:45.973422 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-frngt_382064e7-ae0a-4846-af74-ee367b8b371c/volume-data-source-validator/0.log" Jul 03 19:35:46.012174 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:46.012136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" event={"ID":"623c2240-a8e1-4936-917f-89715e46192b","Type":"ContainerStarted","Data":"8f764fa6524f3ddeef945381a11a27724e884ba7248f48fbb130ac8a54e03fcd"} Jul 03 19:35:46.012375 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:46.012192 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" event={"ID":"623c2240-a8e1-4936-917f-89715e46192b","Type":"ContainerStarted","Data":"0786f192c98051fb9376092961d1c44fde50ccba5c58be372d43bb7944113277"} Jul 03 19:35:46.012375 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:46.012244 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:46.027546 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:46.027498 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" podStartSLOduration=1.027483841 podStartE2EDuration="1.027483841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:35:46.025869317 +0000 UTC m=+1551.522168558" watchObservedRunningTime="2026-07-03 19:35:46.027483841 +0000 UTC m=+1551.523783082" Jul 03 19:35:46.968032 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:46.968006 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dvkr6_e009a38c-af47-4270-b2c1-c8e90de2fb8a/dns/0.log" Jul 03 19:35:46.986438 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:46.986411 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dvkr6_e009a38c-af47-4270-b2c1-c8e90de2fb8a/kube-rbac-proxy/0.log" Jul 03 19:35:47.103435 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:47.103408 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-782f6_74dce66b-24ed-4967-a4a2-8b7710b45015/dns-node-resolver/0.log" Jul 03 19:35:47.755516 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:47.755487 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v68d2_e93e7739-0a8b-4f3f-9a04-6dfdef436237/node-ca/0.log" Jul 03 19:35:48.749482 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:48.749454 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-994f4989b-tmhqs_604bf439-5695-43a2-9bd2-26300ee7a20f/kube-auth-proxy/0.log" Jul 03 19:35:48.914311 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:48.914282 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b8b6fffc9-ks2dx_07a6fca2-14ed-4971-aa93-2f928fbfcf7c/router/0.log" Jul 03 19:35:49.558312 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:49.558282 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x6tdp_48a7b9f2-395c-41f2-8faa-25c05e793fb8/serve-healthcheck-canary/0.log" Jul 03 19:35:50.026449 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:50.026404 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-4zbpv_a976ac92-4645-440d-af46-c5d9b51aa551/insights-operator/0.log" Jul 03 19:35:50.027148 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:50.027120 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-4zbpv_a976ac92-4645-440d-af46-c5d9b51aa551/insights-operator/1.log" Jul 03 19:35:50.171596 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:50.171571 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vnd8r_c707a275-3290-4ec7-973a-a8b5629b99f7/kube-rbac-proxy/0.log" Jul 03 19:35:50.189816 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:50.189781 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vnd8r_c707a275-3290-4ec7-973a-a8b5629b99f7/exporter/0.log" Jul 03 19:35:50.209131 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:50.209110 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vnd8r_c707a275-3290-4ec7-973a-a8b5629b99f7/extractor/0.log" Jul 03 19:35:52.028004 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:52.027977 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gpcc9" Jul 03 19:35:52.618890 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:52.618858 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-896bm_e9256195-5b31-4d9e-8259-8cc01190efdc/manager/0.log" Jul 03 19:35:52.636131 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:52.636111 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-896bm_e9256195-5b31-4d9e-8259-8cc01190efdc/copy-manifests/0.log" Jul 03 19:35:54.034560 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:54.034490 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-569d79d5df-8zf8v_d8b0d560-7f49-44e4-bd3d-f3024640a198/manager/0.log" Jul 03 19:35:55.751036 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:55.751003 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-994f4989b-tmhqs_604bf439-5695-43a2-9bd2-26300ee7a20f/kube-auth-proxy/0.log" Jul 03 19:35:55.886066 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:55.886033 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b8b6fffc9-ks2dx_07a6fca2-14ed-4971-aa93-2f928fbfcf7c/router/0.log" Jul 03 19:35:57.231580 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:57.231551 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-994f4989b-tmhqs_604bf439-5695-43a2-9bd2-26300ee7a20f/kube-auth-proxy/0.log" Jul 03 19:35:57.357941 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:35:57.357915 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b8b6fffc9-ks2dx_07a6fca2-14ed-4971-aa93-2f928fbfcf7c/router/0.log" Jul 03 19:36:00.964724 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:00.964697 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-krpln_de0f9289-f59a-4261-8d85-80f74636a3b0/kube-multus-additional-cni-plugins/0.log" Jul 03 19:36:00.982064 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:00.982043 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-krpln_de0f9289-f59a-4261-8d85-80f74636a3b0/egress-router-binary-copy/0.log" Jul 03 19:36:00.999890 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:00.999869 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-krpln_de0f9289-f59a-4261-8d85-80f74636a3b0/cni-plugins/0.log" Jul 03 19:36:01.017132 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:01.017113 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-krpln_de0f9289-f59a-4261-8d85-80f74636a3b0/bond-cni-plugin/0.log" Jul 03 19:36:01.039628 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:01.039608 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-krpln_de0f9289-f59a-4261-8d85-80f74636a3b0/routeoverride-cni/0.log" Jul 03 19:36:01.057213 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:01.057185 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-krpln_de0f9289-f59a-4261-8d85-80f74636a3b0/whereabouts-cni-bincopy/0.log" Jul 03 19:36:01.074455 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:01.074419 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-krpln_de0f9289-f59a-4261-8d85-80f74636a3b0/whereabouts-cni/0.log" Jul 03 19:36:01.236432 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:01.236393 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hlfrb_f93d73d5-d2c3-4bfb-80da-50c0cc1bb9d1/kube-multus/0.log" Jul 03 19:36:01.360178 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:01.360147 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qjp6f_f18c8179-6720-4e16-84aa-5c360dcf7a9a/network-metrics-daemon/0.log" Jul 03 19:36:01.376871 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:01.376843 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qjp6f_f18c8179-6720-4e16-84aa-5c360dcf7a9a/kube-rbac-proxy/0.log" Jul 03 19:36:02.606779 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:02.606750 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvfrf_c4d12100-7327-46ca-98a8-c5de5bf1fdc3/ovn-controller/0.log" Jul 03 19:36:02.622177 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:02.622143 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvfrf_c4d12100-7327-46ca-98a8-c5de5bf1fdc3/ovn-acl-logging/0.log" Jul 03 19:36:02.644980 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:02.644940 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvfrf_c4d12100-7327-46ca-98a8-c5de5bf1fdc3/kube-rbac-proxy-node/0.log" Jul 03 19:36:02.664528 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:02.664492 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvfrf_c4d12100-7327-46ca-98a8-c5de5bf1fdc3/kube-rbac-proxy-ovn-metrics/0.log" Jul 03 19:36:02.679762 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:02.679733 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvfrf_c4d12100-7327-46ca-98a8-c5de5bf1fdc3/northd/0.log" Jul 03 19:36:02.698153 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:02.698115 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvfrf_c4d12100-7327-46ca-98a8-c5de5bf1fdc3/nbdb/0.log" Jul 03 19:36:02.715906 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:02.715881 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvfrf_c4d12100-7327-46ca-98a8-c5de5bf1fdc3/sbdb/0.log" Jul 03 19:36:02.770923 ip-10-0-132-110 kubenswrapper[2580]: I0703 19:36:02.770892 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvfrf_c4d12100-7327-46ca-98a8-c5de5bf1fdc3/ovnkube-controller/0.log"