Jul 18 00:56:57.830368 ip-10-0-140-116 systemd[1]: Starting Kubernetes Kubelet... Jul 18 00:56:58.208796 ip-10-0-140-116 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:56:58.208796 ip-10-0-140-116 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 18 00:56:58.208796 ip-10-0-140-116 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:56:58.208796 ip-10-0-140-116 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 18 00:56:58.208796 ip-10-0-140-116 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:56:58.211017 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.210938 2548 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 18 00:56:58.218690 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218671 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:56:58.218690 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218686 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:56:58.218690 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218690 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:56:58.218690 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218694 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218697 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218700 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218703 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218706 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218708 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218711 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218713 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218716 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218719 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218721 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218724 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218726 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218728 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218731 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218733 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218736 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218743 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218746 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218748 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:56:58.218814 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218751 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218753 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218755 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218758 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218760 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218763 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218765 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218768 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218770 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218772 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218775 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218777 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218779 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218782 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218787 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218791 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218794 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218797 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218800 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:56:58.219309 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218803 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218806 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218808 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218811 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218814 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218817 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218820 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218822 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218825 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218827 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218830 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218832 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218835 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218838 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218840 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218842 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218846 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218849 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218852 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:56:58.219794 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218855 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218858 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218860 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218863 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218866 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218868 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218871 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218873 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218879 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218882 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218886 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218889 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218893 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218896 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218898 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218900 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218903 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218905 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218908 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218910 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:56:58.220268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218913 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218915 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218917 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218920 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218923 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218925 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218927 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218930 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218932 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218935 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218937 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218940 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218942 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218944 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218947 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218949 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218951 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.218954 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220296 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220305 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:56:58.220738 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220308 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220311 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220315 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220319 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220322 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220325 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220328 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220330 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220333 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220335 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220338 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220340 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220342 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220345 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220350 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220353 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220355 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220358 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220361 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220363 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:56:58.221229 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220366 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220370 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220373 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220376 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220379 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220382 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220385 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220387 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220390 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220392 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220395 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220398 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220400 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220402 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220405 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220408 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220411 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220413 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220415 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220418 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:56:58.221726 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220421 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220423 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220426 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220428 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220430 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220433 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220437 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220440 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220445 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220448 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220451 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220454 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220456 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220459 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220461 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220463 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220466 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220468 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220471 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220473 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:56:58.222268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220476 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220478 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220481 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220483 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220485 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220488 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220491 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220493 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220495 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220498 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220501 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220503 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220505 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220508 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220510 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220512 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220515 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220518 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220523 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220525 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:56:58.222732 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220528 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220531 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220533 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220535 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220538 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220540 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220543 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220546 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220548 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220551 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220553 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220555 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220558 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220560 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220562 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220565 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220568 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220930 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220936 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:56:58.223231 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220939 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220942 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220945 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220948 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220951 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220954 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220958 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220961 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220964 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220966 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220969 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220973 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220976 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220978 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220981 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220984 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220986 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220989 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:56:58.223695 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220991 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220993 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220996 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.220998 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221000 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221003 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221006 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221008 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221011 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221013 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221016 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221018 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221021 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221023 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221026 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221028 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221031 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221034 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221036 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221038 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:56:58.224160 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221040 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221043 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221045 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221048 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221050 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221053 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221055 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221058 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221060 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221063 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221065 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221067 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221070 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221072 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221075 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221077 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221079 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221082 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221084 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221087 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221089 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:56:58.224646 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221106 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221109 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221112 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221115 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221117 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221120 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221122 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221124 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221127 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221130 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221132 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221135 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221137 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221139 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221142 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221144 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221147 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221149 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221152 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221154 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:56:58.225165 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221157 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221159 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221162 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221164 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221166 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221169 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221171 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221173 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221176 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221179 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221183 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221186 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221189 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221192 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221195 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221198 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221200 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221203 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221270 2548 flags.go:64] FLAG: --address="0.0.0.0" Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221281 2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 18 00:56:58.225642 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221287 2548 flags.go:64] FLAG: --anonymous-auth="true" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221290 2548 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221298 2548 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221303 2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221309 2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221315 2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221320 2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221325 2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221328 2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221331 2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221334 2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221337 2548 flags.go:64] FLAG: --cgroup-root="" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221340 2548 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221343 2548 flags.go:64] FLAG: --client-ca-file="" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221345 2548 flags.go:64] FLAG: --cloud-provider="external" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221348 2548 flags.go:64] FLAG: --cluster-dns="[]" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221353 2548 flags.go:64] FLAG: --cluster-domain="" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221355 2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221358 2548 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221361 2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221364 2548 flags.go:64] FLAG: --container-log-max-files="5" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221368 2548 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221370 2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 18 00:56:58.226250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221373 2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221378 2548 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221381 2548 flags.go:64] FLAG: --contention-profiling="false" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221384 2548 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221387 2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221390 2548 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221392 2548 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221396 2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221399 2548 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221402 2548 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221405 2548 flags.go:64] FLAG: --enable-load-reader="false" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221407 2548 flags.go:64] FLAG: --enable-server="true" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221412 2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221416 2548 flags.go:64] FLAG: --event-burst="100" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221419 2548 flags.go:64] FLAG: --event-qps="50" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221422 2548 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221425 2548 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221427 2548 flags.go:64] FLAG: --eviction-hard="" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221431 2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221434 2548 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221437 2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221439 2548 flags.go:64] FLAG: --eviction-soft="" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221442 2548 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221445 2548 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221448 2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 18 00:56:58.226794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221450 2548 flags.go:64] FLAG: --experimental-mounter-path="" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221453 2548 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221456 2548 flags.go:64] FLAG: --fail-swap-on="true" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221459 2548 flags.go:64] FLAG: --feature-gates="" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221462 2548 flags.go:64] FLAG: --file-check-frequency="20s" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221465 2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221468 2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221471 2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221475 2548 flags.go:64] FLAG: --healthz-port="10248" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221478 2548 flags.go:64] FLAG: --help="false" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221480 2548 flags.go:64] FLAG: --hostname-override="ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221483 2548 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221486 2548 flags.go:64] FLAG: --http-check-frequency="20s" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221489 2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221492 2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221495 2548 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221498 2548 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221501 2548 flags.go:64] FLAG: --image-service-endpoint="" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221504 2548 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221507 2548 flags.go:64] FLAG: --kube-api-burst="100" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221511 2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221514 2548 flags.go:64] FLAG: --kube-api-qps="50" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221517 2548 flags.go:64] FLAG: --kube-reserved="" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221520 2548 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 18 00:56:58.227502 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221523 2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221526 2548 flags.go:64] FLAG: --kubelet-cgroups="" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221528 2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221531 2548 flags.go:64] FLAG: --lock-file="" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221533 2548 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221536 2548 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221539 2548 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221544 2548 flags.go:64] FLAG: --log-json-split-stream="false" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221547 2548 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221550 2548 flags.go:64] FLAG: --log-text-split-stream="false" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221552 2548 flags.go:64] FLAG: --logging-format="text" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221555 2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221558 2548 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221561 2548 flags.go:64] FLAG: --manifest-url="" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221564 2548 flags.go:64] FLAG: --manifest-url-header="" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221568 2548 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221572 2548 flags.go:64] FLAG: --max-open-files="1000000" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221576 2548 flags.go:64] FLAG: --max-pods="110" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221579 2548 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221582 2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221585 2548 flags.go:64] FLAG: --memory-manager-policy="None" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221587 2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221590 2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221593 2548 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221595 2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 18 00:56:58.228082 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221602 2548 flags.go:64] FLAG: --node-status-max-images="50" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221605 2548 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221610 2548 flags.go:64] FLAG: --oom-score-adj="-999" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221613 2548 flags.go:64] FLAG: --pod-cidr="" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221616 2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221621 2548 flags.go:64] FLAG: --pod-manifest-path="" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221624 2548 flags.go:64] FLAG: --pod-max-pids="-1" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221627 2548 flags.go:64] FLAG: --pods-per-core="0" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221629 2548 flags.go:64] FLAG: --port="10250" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221632 2548 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221635 2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0863eadf6d1d5c363" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221638 2548 flags.go:64] FLAG: --qos-reserved="" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221641 2548 flags.go:64] FLAG: --read-only-port="10255" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221644 2548 flags.go:64] FLAG: --register-node="true" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221646 2548 flags.go:64] FLAG: --register-with-taints="" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221650 2548 flags.go:64] FLAG: --registry-burst="10" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221652 2548 flags.go:64] FLAG: --registry-qps="5" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221655 2548 flags.go:64] FLAG: --reserved-cpus="" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221658 2548 flags.go:64] FLAG: --reserved-memory="" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221661 2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221663 2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221666 2548 flags.go:64] FLAG: --rotate-certificates="false" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221669 2548 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221673 2548 flags.go:64] FLAG: --runonce="false" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221676 2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 18 00:56:58.229089 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221678 2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221681 2548 flags.go:64] FLAG: --seccomp-default="false" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221684 2548 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221686 2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221689 2548 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221692 2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221695 2548 flags.go:64] FLAG: --storage-driver-password="root" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221698 2548 flags.go:64] FLAG: --storage-driver-secure="false" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221701 2548 flags.go:64] FLAG: --storage-driver-table="stats" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221703 2548 flags.go:64] FLAG: --storage-driver-user="root" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221707 2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221710 2548 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221713 2548 flags.go:64] FLAG: --system-cgroups="" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221716 2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221721 2548 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221724 2548 flags.go:64] FLAG: --tls-cert-file="" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221726 2548 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221731 2548 flags.go:64] FLAG: --tls-min-version="" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221734 2548 flags.go:64] FLAG: --tls-private-key-file="" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221736 2548 flags.go:64] FLAG: --topology-manager-policy="none" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221739 2548 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221742 2548 flags.go:64] FLAG: --topology-manager-scope="container" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221745 2548 flags.go:64] FLAG: --v="2" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221748 2548 flags.go:64] FLAG: --version="false" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221752 2548 flags.go:64] FLAG: --vmodule="" Jul 18 00:56:58.230180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221755 2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.221758 2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221866 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221870 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221874 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221878 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221881 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221884 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221887 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221889 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221892 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221894 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221896 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221899 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221902 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221904 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221907 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221910 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221913 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221915 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:56:58.231242 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221919 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221923 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221927 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221930 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221933 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221935 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221938 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221941 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221943 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221946 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221949 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221951 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221954 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221956 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221959 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221962 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221964 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221968 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221970 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221973 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:56:58.231942 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221975 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221978 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221981 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221983 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221985 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221988 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221990 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221993 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221995 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.221999 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222001 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222004 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222007 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222010 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222012 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222015 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222017 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222020 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222022 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:56:58.232561 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222024 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222028 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222032 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222034 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222037 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222039 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222042 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222044 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222046 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222049 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222053 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222055 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222057 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222060 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222062 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222065 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222067 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222070 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222072 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222075 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:56:58.233051 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222077 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222079 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222083 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222085 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222088 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222104 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222107 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222110 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222112 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222115 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222117 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222120 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222122 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222125 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222127 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222130 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222132 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222134 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:56:58.233623 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222137 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222141 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222144 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.222147 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.222771 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.230364 2548 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.230384 2548 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.230408 2548 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.230418 2548 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230500 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230508 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230513 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230518 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230523 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:56:58.234050 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230527 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230533 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230540 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230545 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230549 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230554 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230558 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230562 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230567 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230571 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230575 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230579 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230584 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230588 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230592 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230596 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230600 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230604 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230608 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:56:58.234422 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230612 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230616 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230620 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230624 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230629 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230635 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230639 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230643 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230647 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230651 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230657 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230663 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230668 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230672 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230677 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230682 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230686 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230690 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230694 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230698 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:56:58.234880 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230703 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230707 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230712 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230716 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230720 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230724 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230728 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230733 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230737 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230741 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230745 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230749 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230753 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230757 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230762 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230766 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230770 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230775 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230779 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230783 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:56:58.235548 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230787 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230792 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230796 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230800 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230804 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230808 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230812 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230816 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230821 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230825 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230829 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230833 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230837 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230841 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230845 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230849 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230853 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230857 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230861 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:56:58.236112 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230865 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230870 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230877 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230882 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230887 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230892 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230896 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230901 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230906 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230911 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230915 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230920 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230925 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230929 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230934 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:56:58.236571 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.230938 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.230946 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232240 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232265 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232272 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232277 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232283 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232287 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232291 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232297 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232302 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232307 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232311 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232319 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232324 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:56:58.237007 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232327 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232330 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232332 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232336 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232338 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232359 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232363 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232379 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232485 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232493 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232496 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232499 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232504 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232508 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232511 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232514 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232517 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232520 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232522 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:56:58.237399 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232525 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232528 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232535 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232538 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232540 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232543 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232546 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232548 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232551 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232553 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232556 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232558 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232560 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232563 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232566 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232569 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232571 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232574 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232577 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232580 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:56:58.237903 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232582 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232585 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232588 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232590 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232593 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232596 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232598 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232601 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232603 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232606 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232609 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232611 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232614 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232617 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232620 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232623 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232626 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232628 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232631 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232633 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:56:58.238387 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232636 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232638 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232642 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232645 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232647 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232650 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232653 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232655 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232657 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232660 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232662 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232665 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232667 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232669 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232672 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232674 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232677 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232679 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232681 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232684 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:56:58.238867 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232686 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232689 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232692 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232694 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232696 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232700 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:58.232702 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.232708 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.232821 2548 server.go:962] "Client rotation is on, will bootstrap in background" Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.235220 2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.236881 2548 server.go:1019] "Starting client certificate rotation" Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.236979 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.237008 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 00:56:58.239725 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.239639 2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 00:56:58.241000 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.240977 2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 00:56:58.253174 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.253121 2548 log.go:25] "Validated CRI v1 runtime API" Jul 18 00:56:58.255714 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.255698 2548 log.go:25] "Validated CRI v1 image API" Jul 18 00:56:58.256495 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.256480 2548 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 18 00:56:58.258870 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.258853 2548 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e1d6ee00-e695-42f4-8fa5-087c75b6e843:/dev/nvme0n1p3 e7f1ea35-5abb-41a2-bb6e-2060a141e3d2:/dev/nvme0n1p4] Jul 18 00:56:58.258928 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.258870 2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 18 00:56:58.263939 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.263834 2548 manager.go:216] Machine: {Timestamp:2026-07-18 00:56:58.262565717 +0000 UTC m=+0.318903242 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3115503 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec245a56e1dc487ac32ad8cfde30f392 SystemUUID:ec245a56-e1dc-487a-c32a-d8cfde30f392 BootID:be195419-540e-47be-800f-56a0166eb7eb Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:70:1c:6d:9a:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:70:1c:6d:9a:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:41:d5:1b:b2:30 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 18 00:56:58.263939 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.263934 2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 18 00:56:58.264055 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.264005 2548 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 18 00:56:58.266909 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.266882 2548 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 18 00:56:58.267042 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.266914 2548 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 18 00:56:58.267714 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.267703 2548 topology_manager.go:138] "Creating topology manager with none policy" Jul 18 00:56:58.267756 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.267716 2548 container_manager_linux.go:309] "Creating device plugin manager" Jul 18 00:56:58.267756 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.267724 2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 00:56:58.268588 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.268577 2548 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 00:56:58.268901 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.268887 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 00:56:58.270447 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.270435 2548 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 18 00:56:58.275055 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.275043 2548 state_mem.go:36] "Initialized new in-memory state store" Jul 18 00:56:58.275186 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.275175 2548 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 18 00:56:58.275235 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.275205 2548 kubelet.go:486] "Attempting to sync node with API server" Jul 18 00:56:58.275235 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.275215 2548 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 18 00:56:58.275235 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.275228 2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 18 00:56:58.275358 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.275238 2548 kubelet.go:398] "Adding apiserver pod source" Jul 18 00:56:58.275358 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.275246 2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 18 00:56:58.275687 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.275668 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 00:56:58.275768 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.275695 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 00:56:58.279248 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.279230 2548 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 18 00:56:58.280929 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.280915 2548 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 18 00:56:58.280984 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.280946 2548 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 18 00:56:58.281751 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281740 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 18 00:56:58.281789 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281756 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 18 00:56:58.281789 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281762 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 18 00:56:58.281789 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281779 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 18 00:56:58.281789 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281789 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 18 00:56:58.281896 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281795 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 18 00:56:58.281896 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281803 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 18 00:56:58.281896 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281808 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 18 00:56:58.281896 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281815 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 18 00:56:58.281896 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281820 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 18 00:56:58.281896 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281828 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 18 00:56:58.281896 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281833 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 18 00:56:58.281896 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281855 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 18 00:56:58.281896 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.281860 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 18 00:56:58.284849 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.284834 2548 server.go:1268] "Started kubelet" Jul 18 00:56:58.284965 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.284918 2548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 18 00:56:58.285023 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.284986 2548 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 18 00:56:58.285135 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.284928 2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 18 00:56:58.285739 ip-10-0-140-116 systemd[1]: Started Kubernetes Kubelet. Jul 18 00:56:58.286450 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.286426 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 18 00:56:58.286522 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.286477 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 18 00:56:58.286664 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.286549 2548 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 18 00:56:58.286714 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.286669 2548 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 18 00:56:58.287559 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.287543 2548 server.go:310] "Adding debug handlers to kubelet server" Jul 18 00:56:58.289798 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.289773 2548 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 18 00:56:58.290233 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.289201 2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-116.ec2.internal.18c33c5632bad4b0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-116.ec2.internal,UID:ip-10-0-140-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-116.ec2.internal,},FirstTimestamp:2026-07-18 00:56:58.284807344 +0000 UTC m=+0.341144866,LastTimestamp:2026-07-18 00:56:58.284807344 +0000 UTC m=+0.341144866,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-116.ec2.internal,}" Jul 18 00:56:58.293248 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.293229 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9jt2" Jul 18 00:56:58.297295 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.297278 2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 18 00:56:58.297385 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.297362 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 18 00:56:58.297733 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.297715 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:58.298068 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.298046 2548 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 18 00:56:58.298068 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.298048 2548 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 18 00:56:58.298375 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.298075 2548 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 18 00:56:58.298375 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.298211 2548 reconstruct.go:97] "Volume reconstruction finished" Jul 18 00:56:58.298375 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.298220 2548 reconciler.go:29] "Reconciler: start to sync state" Jul 18 00:56:58.299024 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.299008 2548 factory.go:153] Registering CRI-O factory Jul 18 00:56:58.299024 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.299026 2548 factory.go:223] Registration of the crio container factory successfully Jul 18 00:56:58.299177 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.299044 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9jt2" Jul 18 00:56:58.299177 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.299087 2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 18 00:56:58.299177 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.299119 2548 factory.go:55] Registering systemd factory Jul 18 00:56:58.299177 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.299128 2548 factory.go:223] Registration of the systemd container factory successfully Jul 18 00:56:58.299177 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.299148 2548 factory.go:103] Registering Raw factory Jul 18 00:56:58.299177 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.299166 2548 manager.go:1196] Started watching for new ooms in manager Jul 18 00:56:58.299653 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.299630 2548 manager.go:349] Starting recovery of all containers Jul 18 00:56:58.300848 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.300820 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 18 00:56:58.300942 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.300910 2548 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 18 00:56:58.311246 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.311042 2548 manager.go:354] Recovery completed Jul 18 00:56:58.315598 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.315584 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:56:58.317354 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.317335 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:56:58.317443 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.317369 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:56:58.317443 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.317383 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:56:58.317977 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.317962 2548 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 18 00:56:58.317977 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.317972 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:56:58.318079 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.317975 2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 18 00:56:58.318079 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.318032 2548 state_mem.go:36] "Initialized new in-memory state store" Jul 18 00:56:58.318553 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.318540 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:56:58.318593 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.318567 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:56:58.318593 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.318579 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:56:58.320134 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.320114 2548 policy_none.go:49] "None policy: Start" Jul 18 00:56:58.320134 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.320139 2548 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 18 00:56:58.320217 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.320165 2548 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 18 00:56:58.322084 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.322073 2548 policy_none.go:47] "Start" Jul 18 00:56:58.356633 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.356611 2548 manager.go:337] "Starting Device Plugin manager" Jul 18 00:56:58.356701 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.356639 2548 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 18 00:56:58.356701 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.356648 2548 server.go:87] "Starting device plugin registration server" Jul 18 00:56:58.356892 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.356881 2548 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 18 00:56:58.356988 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.356892 2548 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 18 00:56:58.357037 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.356993 2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 18 00:56:58.357087 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.357077 2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 18 00:56:58.357087 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.357086 2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 18 00:56:58.357603 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.357582 2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 18 00:56:58.357686 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.357637 2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:58.457548 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.457520 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:56:58.459657 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.458463 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:56:58.459657 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.458495 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:56:58.459657 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.458504 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:56:58.459657 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.458535 2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.464133 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.464120 2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.464183 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.464139 2548 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-116.ec2.internal\": node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:58.470525 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.470504 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 18 00:56:58.471849 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.471821 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 18 00:56:58.471936 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.471857 2548 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 18 00:56:58.471936 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.471877 2548 kubelet.go:2448] "Starting kubelet main sync loop" Jul 18 00:56:58.471936 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.471906 2548 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 18 00:56:58.473896 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.473877 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:56:58.480853 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.480833 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:58.572759 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.572729 2548 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-116.ec2.internal"] Jul 18 00:56:58.572837 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.572808 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:56:58.573613 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.573594 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:56:58.573692 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.573625 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:56:58.573692 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.573635 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:56:58.575921 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.575909 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:56:58.576035 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.576019 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.576073 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.576058 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:56:58.576583 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.576567 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:56:58.576648 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.576594 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:56:58.576648 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.576609 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:56:58.576716 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.576661 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:56:58.576716 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.576696 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:56:58.576716 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.576711 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:56:58.578826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.578811 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.578907 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.578837 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:56:58.579451 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.579436 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:56:58.579527 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.579462 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:56:58.579527 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.579471 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:56:58.580919 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.580901 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:58.599596 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.599576 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52b0e16400b201ca7843df9c2c64cd1a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-116.ec2.internal\" (UID: \"52b0e16400b201ca7843df9c2c64cd1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.599675 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.599603 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/15380bb3effd40c7d9e614160047b48f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal\" (UID: \"15380bb3effd40c7d9e614160047b48f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.599675 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.599619 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15380bb3effd40c7d9e614160047b48f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal\" (UID: \"15380bb3effd40c7d9e614160047b48f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.601614 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.601599 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-116.ec2.internal\" not found" node="ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.605995 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.605979 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-116.ec2.internal\" not found" node="ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.681090 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.681066 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:58.700442 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.700422 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52b0e16400b201ca7843df9c2c64cd1a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-116.ec2.internal\" (UID: \"52b0e16400b201ca7843df9c2c64cd1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.700495 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.700387 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52b0e16400b201ca7843df9c2c64cd1a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-116.ec2.internal\" (UID: \"52b0e16400b201ca7843df9c2c64cd1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.700495 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.700491 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/15380bb3effd40c7d9e614160047b48f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal\" (UID: \"15380bb3effd40c7d9e614160047b48f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.700555 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.700509 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15380bb3effd40c7d9e614160047b48f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal\" (UID: \"15380bb3effd40c7d9e614160047b48f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.700555 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.700531 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15380bb3effd40c7d9e614160047b48f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal\" (UID: \"15380bb3effd40c7d9e614160047b48f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.700615 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.700558 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/15380bb3effd40c7d9e614160047b48f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal\" (UID: \"15380bb3effd40c7d9e614160047b48f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.781816 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.781756 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:58.882404 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.882367 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:58.903833 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.903814 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.911121 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:58.911085 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-116.ec2.internal" Jul 18 00:56:58.983255 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:58.983218 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:59.083755 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:59.083688 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:59.184295 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:59.184247 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:59.235774 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.235747 2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 18 00:56:59.236276 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.235888 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 00:56:59.254959 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.254939 2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:56:59.284479 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:59.284454 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:59.306385 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.306357 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 00:51:59 +0000 UTC" deadline="2028-03-07 10:07:45.467400721 +0000 UTC" Jul 18 00:56:59.306385 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.306380 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14361h10m46.161023009s" Jul 18 00:56:59.384698 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:59.384649 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:59.485214 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:59.485190 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:59.524022 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:59.523994 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15380bb3effd40c7d9e614160047b48f.slice/crio-2d4af28953747e9222f56db141a1c33a3cdc03f90fca360749616187419868cf WatchSource:0}: Error finding container 2d4af28953747e9222f56db141a1c33a3cdc03f90fca360749616187419868cf: Status 404 returned error can't find the container with id 2d4af28953747e9222f56db141a1c33a3cdc03f90fca360749616187419868cf Jul 18 00:56:59.524245 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:56:59.524223 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b0e16400b201ca7843df9c2c64cd1a.slice/crio-185c8802e1eca864e9cedae3a4192178c18d97922d0921d2e2fe7041e30abb0d WatchSource:0}: Error finding container 185c8802e1eca864e9cedae3a4192178c18d97922d0921d2e2fe7041e30abb0d: Status 404 returned error can't find the container with id 185c8802e1eca864e9cedae3a4192178c18d97922d0921d2e2fe7041e30abb0d Jul 18 00:56:59.529342 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.529328 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 00:56:59.585409 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:56:59.585372 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-116.ec2.internal\" not found" Jul 18 00:56:59.678509 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.678449 2548 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:56:59.698749 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.698727 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" Jul 18 00:56:59.711921 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.711903 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 00:56:59.712915 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.712900 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-116.ec2.internal" Jul 18 00:56:59.720939 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.720924 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 00:56:59.903629 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:56:59.903599 2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:57:00.276410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.276379 2548 apiserver.go:52] "Watching apiserver" Jul 18 00:57:00.288289 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.288084 2548 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 18 00:57:00.288506 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.288481 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-4cvp2","openshift-image-registry/node-ca-fpxss","openshift-multus/network-metrics-daemon-tsk8r","openshift-network-operator/iptables-alerter-7mljf","openshift-ovn-kubernetes/ovnkube-node-k8r2t","kube-system/global-pull-secret-syncer-cggnq","kube-system/konnectivity-agent-gzsm5","kube-system/kube-apiserver-proxy-ip-10-0-140-116.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal","openshift-multus/multus-additional-cni-plugins-vmhnr","openshift-multus/multus-hrn8p","openshift-network-diagnostics/network-check-target-rfltr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx","openshift-cluster-node-tuning-operator/tuned-dzqfp"] Jul 18 00:57:00.291324 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.291199 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:00.294146 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.294123 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 18 00:57:00.294387 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.294366 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 18 00:57:00.294629 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.294610 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dq77x\"" Jul 18 00:57:00.294848 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.294833 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.296900 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.296713 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:00.296900 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.296803 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:00.300878 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.298274 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 18 00:57:00.300878 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.298512 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dwrjh\"" Jul 18 00:57:00.300878 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.298807 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 18 00:57:00.300878 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.299030 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 18 00:57:00.300878 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.299268 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7mljf" Jul 18 00:57:00.300878 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.299995 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 18 00:57:00.301785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.301736 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.302428 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.302247 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 18 00:57:00.303483 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.302852 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:57:00.303483 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.303065 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 18 00:57:00.303483 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.303288 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5c7z9\"" Jul 18 00:57:00.305445 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.304680 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 18 00:57:00.307149 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.305790 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:00.307149 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.306151 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 18 00:57:00.307149 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.306371 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 18 00:57:00.307149 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.306529 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dfdpq\"" Jul 18 00:57:00.307149 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.306679 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 18 00:57:00.307149 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.306860 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 18 00:57:00.307149 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.307029 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 18 00:57:00.307678 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.307572 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:00.307886 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.307840 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.310374 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.310317 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-var-lib-openvswitch\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.310531 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.310482 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 18 00:57:00.310531 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.310516 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4cvp2" Jul 18 00:57:00.310900 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.310788 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xzpgm\"" Jul 18 00:57:00.310900 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.310852 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:57:00.311139 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.310393 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-node-log\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311139 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.310991 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311139 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311032 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-cni-netd\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311139 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311059 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3930b07b-fdef-4e96-822b-ef433209ee78-ovnkube-config\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311139 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311085 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3930b07b-fdef-4e96-822b-ef433209ee78-env-overrides\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311434 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311152 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.311434 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311190 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:00.311434 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311225 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-kubelet\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311434 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311250 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-run-systemd\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311434 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311274 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-etc-openvswitch\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311434 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311297 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-log-socket\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311434 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311322 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f-iptables-alerter-script\") pod \"iptables-alerter-7mljf\" (UID: \"4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f\") " pod="openshift-network-operator/iptables-alerter-7mljf" Jul 18 00:57:00.311434 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311349 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-systemd-units\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311434 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311386 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmxjr\" (UniqueName: \"kubernetes.io/projected/3930b07b-fdef-4e96-822b-ef433209ee78-kube-api-access-vmxjr\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311439 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bced967c-ed04-4dbe-bdbf-c631f9c7d849-agent-certs\") pod \"konnectivity-agent-gzsm5\" (UID: \"bced967c-ed04-4dbe-bdbf-c631f9c7d849\") " pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311471 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311500 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqtb4\" (UniqueName: \"kubernetes.io/projected/630ff042-40db-46b6-932b-0f9397699eeb-kube-api-access-lqtb4\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311528 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bced967c-ed04-4dbe-bdbf-c631f9c7d849-konnectivity-ca\") pod \"konnectivity-agent-gzsm5\" (UID: \"bced967c-ed04-4dbe-bdbf-c631f9c7d849\") " pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311570 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311622 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3930b07b-fdef-4e96-822b-ef433209ee78-ovn-node-metrics-cert\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311648 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311680 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311703 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-run-openvswitch\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311743 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311768 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f-host-slash\") pod \"iptables-alerter-7mljf\" (UID: \"4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f\") " pod="openshift-network-operator/iptables-alerter-7mljf" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311785 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-slash\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.311840 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311831 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-run-netns\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.312581 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311870 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-run-ovn\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.312581 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311891 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-cni-bin\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.312581 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311909 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-device-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.312581 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311930 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3930b07b-fdef-4e96-822b-ef433209ee78-ovnkube-script-lib\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.312581 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.311994 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjpwg\" (UniqueName: \"kubernetes.io/projected/2a03b934-a48a-4a2d-a72c-11faf54565e1-kube-api-access-pjpwg\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:00.312581 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.312049 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzqzr\" (UniqueName: \"kubernetes.io/projected/4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f-kube-api-access-wzqzr\") pod \"iptables-alerter-7mljf\" (UID: \"4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f\") " pod="openshift-network-operator/iptables-alerter-7mljf" Jul 18 00:57:00.314408 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.313212 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fpxss" Jul 18 00:57:00.314408 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.313683 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 18 00:57:00.314408 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.313864 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jqx7p\"" Jul 18 00:57:00.315472 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.314990 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 18 00:57:00.316097 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.315512 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.316314 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.316292 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tsb8w\"" Jul 18 00:57:00.316521 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.316505 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 18 00:57:00.316805 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.316787 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 18 00:57:00.318147 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.316930 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 00:57:00.318489 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.317574 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 18 00:57:00.318489 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.318407 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 18 00:57:00.322334 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.319680 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.322334 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.321639 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:00.322334 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.321712 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:00.323505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.322849 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 18 00:57:00.323505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.322990 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cmvrc\"" Jul 18 00:57:00.323505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.323153 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 18 00:57:00.323505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.323247 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 18 00:57:00.323505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.323404 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 18 00:57:00.325407 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.325223 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 18 00:57:00.327404 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.326414 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g48xj\"" Jul 18 00:57:00.334424 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.334371 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sbcf6" Jul 18 00:57:00.342801 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.342776 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sbcf6" Jul 18 00:57:00.399342 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.399322 2548 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412328 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-cnibin\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412370 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f129dca4-c3bb-40b4-96ce-1c13165d56b9-host\") pod \"node-ca-fpxss\" (UID: \"f129dca4-c3bb-40b4-96ce-1c13165d56b9\") " pod="openshift-image-registry/node-ca-fpxss" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412403 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-run-ovn\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412429 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-cni-bin\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412455 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-device-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412483 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-os-release\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412511 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db80b378-dd0f-4823-83b6-f7b2596fa989-dbus\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412534 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67fb3091-553a-40ed-bd3e-aad25bd36051-cni-binary-copy\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412561 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3930b07b-fdef-4e96-822b-ef433209ee78-ovnkube-script-lib\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412585 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpdz2\" (UniqueName: \"kubernetes.io/projected/67fb3091-553a-40ed-bd3e-aad25bd36051-kube-api-access-cpdz2\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412609 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-kubernetes\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412635 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f-iptables-alerter-script\") pod \"iptables-alerter-7mljf\" (UID: \"4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f\") " pod="openshift-network-operator/iptables-alerter-7mljf" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412657 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412685 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-var-lib-openvswitch\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412714 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412739 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-cni-netd\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.418214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412764 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-run-multus-certs\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412793 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-kubelet\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412815 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-etc-openvswitch\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412830 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412846 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54lts\" (UniqueName: \"kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts\") pod \"network-check-target-rfltr\" (UID: \"bc894046-889c-47dd-989e-d8d4cf0d3114\") " pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412863 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmxjr\" (UniqueName: \"kubernetes.io/projected/3930b07b-fdef-4e96-822b-ef433209ee78-kube-api-access-vmxjr\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412884 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bced967c-ed04-4dbe-bdbf-c631f9c7d849-agent-certs\") pod \"konnectivity-agent-gzsm5\" (UID: \"bced967c-ed04-4dbe-bdbf-c631f9c7d849\") " pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412918 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqtb4\" (UniqueName: \"kubernetes.io/projected/630ff042-40db-46b6-932b-0f9397699eeb-kube-api-access-lqtb4\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412934 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-socket-dir-parent\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412949 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-run-k8s-cni-cncf-io\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412977 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-sysctl-d\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.412996 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56960201-977c-4199-ae5c-609f7b8e79e8-hosts-file\") pod \"node-resolver-4cvp2\" (UID: \"56960201-977c-4199-ae5c-609f7b8e79e8\") " pod="openshift-dns/node-resolver-4cvp2" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413020 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56960201-977c-4199-ae5c-609f7b8e79e8-tmp-dir\") pod \"node-resolver-4cvp2\" (UID: \"56960201-977c-4199-ae5c-609f7b8e79e8\") " pod="openshift-dns/node-resolver-4cvp2" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413036 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bced967c-ed04-4dbe-bdbf-c631f9c7d849-konnectivity-ca\") pod \"konnectivity-agent-gzsm5\" (UID: \"bced967c-ed04-4dbe-bdbf-c631f9c7d849\") " pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413055 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413085 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.418990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413115 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413137 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-var-lib-cni-multus\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413159 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvb2r\" (UniqueName: \"kubernetes.io/projected/f129dca4-c3bb-40b4-96ce-1c13165d56b9-kube-api-access-tvb2r\") pod \"node-ca-fpxss\" (UID: \"f129dca4-c3bb-40b4-96ce-1c13165d56b9\") " pod="openshift-image-registry/node-ca-fpxss" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413199 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413226 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413255 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f-host-slash\") pod \"iptables-alerter-7mljf\" (UID: \"4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f\") " pod="openshift-network-operator/iptables-alerter-7mljf" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413280 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-cni-dir\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413305 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-modprobe-d\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413351 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-sysconfig\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413378 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87bxw\" (UniqueName: \"kubernetes.io/projected/56960201-977c-4199-ae5c-609f7b8e79e8-kube-api-access-87bxw\") pod \"node-resolver-4cvp2\" (UID: \"56960201-977c-4199-ae5c-609f7b8e79e8\") " pod="openshift-dns/node-resolver-4cvp2" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413406 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-slash\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413436 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-var-lib-kubelet\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413465 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-run-netns\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413483 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-etc-kubernetes\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413498 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-var-lib-cni-bin\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413523 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjpwg\" (UniqueName: \"kubernetes.io/projected/2a03b934-a48a-4a2d-a72c-11faf54565e1-kube-api-access-pjpwg\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413551 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzqzr\" (UniqueName: \"kubernetes.io/projected/4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f-kube-api-access-wzqzr\") pod \"iptables-alerter-7mljf\" (UID: \"4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f\") " pod="openshift-network-operator/iptables-alerter-7mljf" Jul 18 00:57:00.419785 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413574 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-os-release\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413593 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413611 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd7c2\" (UniqueName: \"kubernetes.io/projected/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-kube-api-access-zd7c2\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413628 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/708e0235-4105-4330-8214-b1a1c563c231-tmp\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413653 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-system-cni-dir\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413678 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-run-netns\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413707 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-node-log\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413736 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3930b07b-fdef-4e96-822b-ef433209ee78-ovnkube-config\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413762 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3930b07b-fdef-4e96-822b-ef433209ee78-env-overrides\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413791 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413819 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413847 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-var-lib-kubelet\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413878 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-run-systemd\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413903 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-log-socket\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413932 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-conf-dir\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413963 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-systemd\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.413989 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-host\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.420688 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414018 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-systemd-units\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414046 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414078 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-hostroot\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414106 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-daemon-config\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414135 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trnk7\" (UniqueName: \"kubernetes.io/projected/708e0235-4105-4330-8214-b1a1c563c231-kube-api-access-trnk7\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414163 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f129dca4-c3bb-40b4-96ce-1c13165d56b9-serviceca\") pod \"node-ca-fpxss\" (UID: \"f129dca4-c3bb-40b4-96ce-1c13165d56b9\") " pod="openshift-image-registry/node-ca-fpxss" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414208 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-system-cni-dir\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414233 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-run\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414259 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-lib-modules\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414284 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/708e0235-4105-4330-8214-b1a1c563c231-etc-tuned\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414342 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3930b07b-fdef-4e96-822b-ef433209ee78-ovn-node-metrics-cert\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414374 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-run-openvswitch\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414405 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414437 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db80b378-dd0f-4823-83b6-f7b2596fa989-kubelet-config\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414470 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-sysctl-conf\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414498 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-sys\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414525 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-cnibin\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.421603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414664 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-run-ovn\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414716 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-cni-bin\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.414778 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-device-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.415507 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3930b07b-fdef-4e96-822b-ef433209ee78-ovnkube-script-lib\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.416063 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f-iptables-alerter-script\") pod \"iptables-alerter-7mljf\" (UID: \"4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f\") " pod="openshift-network-operator/iptables-alerter-7mljf" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.416147 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-var-lib-openvswitch\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.416219 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.416265 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-cni-netd\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.416319 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-kubelet\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.416366 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-etc-openvswitch\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.417006 2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.417438 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-slash\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.417458 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.417516 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-run-netns\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.417594 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.417611 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.417663 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-node-log\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.417707 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f-host-slash\") pod \"iptables-alerter-7mljf\" (UID: \"4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f\") " pod="openshift-network-operator/iptables-alerter-7mljf" Jul 18 00:57:00.422446 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.417834 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bced967c-ed04-4dbe-bdbf-c631f9c7d849-konnectivity-ca\") pod \"konnectivity-agent-gzsm5\" (UID: \"bced967c-ed04-4dbe-bdbf-c631f9c7d849\") " pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.418019 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-run-systemd\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.418152 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.418309 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3930b07b-fdef-4e96-822b-ef433209ee78-ovnkube-config\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.418367 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3930b07b-fdef-4e96-822b-ef433209ee78-env-overrides\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.418433 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.418448 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-systemd-units\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.418460 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-log-socket\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.418373 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/630ff042-40db-46b6-932b-0f9397699eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.418510 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3930b07b-fdef-4e96-822b-ef433209ee78-run-openvswitch\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.418535 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.418619 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs podName:2a03b934-a48a-4a2d-a72c-11faf54565e1 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:00.918586015 +0000 UTC m=+2.974923551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs") pod "network-metrics-daemon-tsk8r" (UID: "2a03b934-a48a-4a2d-a72c-11faf54565e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.421015 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3930b07b-fdef-4e96-822b-ef433209ee78-ovn-node-metrics-cert\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.423026 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.421165 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bced967c-ed04-4dbe-bdbf-c631f9c7d849-agent-certs\") pod \"konnectivity-agent-gzsm5\" (UID: \"bced967c-ed04-4dbe-bdbf-c631f9c7d849\") " pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:00.427696 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.427670 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqtb4\" (UniqueName: \"kubernetes.io/projected/630ff042-40db-46b6-932b-0f9397699eeb-kube-api-access-lqtb4\") pod \"aws-ebs-csi-driver-node-xbhmx\" (UID: \"630ff042-40db-46b6-932b-0f9397699eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.427853 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.427829 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmxjr\" (UniqueName: \"kubernetes.io/projected/3930b07b-fdef-4e96-822b-ef433209ee78-kube-api-access-vmxjr\") pod \"ovnkube-node-k8r2t\" (UID: \"3930b07b-fdef-4e96-822b-ef433209ee78\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.430514 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.430489 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjpwg\" (UniqueName: \"kubernetes.io/projected/2a03b934-a48a-4a2d-a72c-11faf54565e1-kube-api-access-pjpwg\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:00.432288 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.432267 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzqzr\" (UniqueName: \"kubernetes.io/projected/4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f-kube-api-access-wzqzr\") pod \"iptables-alerter-7mljf\" (UID: \"4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f\") " pod="openshift-network-operator/iptables-alerter-7mljf" Jul 18 00:57:00.454617 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.454588 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:57:00.477807 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.477744 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-116.ec2.internal" event={"ID":"52b0e16400b201ca7843df9c2c64cd1a","Type":"ContainerStarted","Data":"185c8802e1eca864e9cedae3a4192178c18d97922d0921d2e2fe7041e30abb0d"} Jul 18 00:57:00.481717 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.481683 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" event={"ID":"15380bb3effd40c7d9e614160047b48f","Type":"ContainerStarted","Data":"2d4af28953747e9222f56db141a1c33a3cdc03f90fca360749616187419868cf"} Jul 18 00:57:00.515575 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515546 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-hostroot\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.515575 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515580 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-daemon-config\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.515796 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515603 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trnk7\" (UniqueName: \"kubernetes.io/projected/708e0235-4105-4330-8214-b1a1c563c231-kube-api-access-trnk7\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.515796 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515626 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f129dca4-c3bb-40b4-96ce-1c13165d56b9-serviceca\") pod \"node-ca-fpxss\" (UID: \"f129dca4-c3bb-40b4-96ce-1c13165d56b9\") " pod="openshift-image-registry/node-ca-fpxss" Jul 18 00:57:00.515796 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515649 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-system-cni-dir\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.515796 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515672 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-run\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.515796 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515677 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-hostroot\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.515796 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515725 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-system-cni-dir\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.515796 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515778 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-run\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515873 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-lib-modules\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515907 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/708e0235-4105-4330-8214-b1a1c563c231-etc-tuned\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515938 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db80b378-dd0f-4823-83b6-f7b2596fa989-kubelet-config\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515965 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-sysctl-conf\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.515989 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-sys\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516013 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-cnibin\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516039 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-cnibin\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516041 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-lib-modules\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516063 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f129dca4-c3bb-40b4-96ce-1c13165d56b9-host\") pod \"node-ca-fpxss\" (UID: \"f129dca4-c3bb-40b4-96ce-1c13165d56b9\") " pod="openshift-image-registry/node-ca-fpxss" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516089 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-os-release\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516102 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-sys\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.516137 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516134 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db80b378-dd0f-4823-83b6-f7b2596fa989-dbus\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516160 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67fb3091-553a-40ed-bd3e-aad25bd36051-cni-binary-copy\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516169 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db80b378-dd0f-4823-83b6-f7b2596fa989-kubelet-config\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516187 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpdz2\" (UniqueName: \"kubernetes.io/projected/67fb3091-553a-40ed-bd3e-aad25bd36051-kube-api-access-cpdz2\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516192 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f129dca4-c3bb-40b4-96ce-1c13165d56b9-serviceca\") pod \"node-ca-fpxss\" (UID: \"f129dca4-c3bb-40b4-96ce-1c13165d56b9\") " pod="openshift-image-registry/node-ca-fpxss" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516213 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-kubernetes\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516241 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516264 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-os-release\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516272 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-run-multus-certs\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516289 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-daemon-config\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516300 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516305 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-cnibin\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516351 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f129dca4-c3bb-40b4-96ce-1c13165d56b9-host\") pod \"node-ca-fpxss\" (UID: \"f129dca4-c3bb-40b4-96ce-1c13165d56b9\") " pod="openshift-image-registry/node-ca-fpxss" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516354 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-cnibin\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516292 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-sysctl-conf\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516352 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54lts\" (UniqueName: \"kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts\") pod \"network-check-target-rfltr\" (UID: \"bc894046-889c-47dd-989e-d8d4cf0d3114\") " pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.516407 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516408 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db80b378-dd0f-4823-83b6-f7b2596fa989-dbus\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:00.516750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516537 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-kubernetes\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.516602 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret podName:db80b378-dd0f-4823-83b6-f7b2596fa989 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:01.016582408 +0000 UTC m=+3.072919934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret") pod "global-pull-secret-syncer-cggnq" (UID: "db80b378-dd0f-4823-83b6-f7b2596fa989") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516632 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516696 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67fb3091-553a-40ed-bd3e-aad25bd36051-cni-binary-copy\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516703 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-socket-dir-parent\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516739 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-run-k8s-cni-cncf-io\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516660 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-run-multus-certs\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516761 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-socket-dir-parent\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516801 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-sysctl-d\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516807 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-run-k8s-cni-cncf-io\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516851 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56960201-977c-4199-ae5c-609f7b8e79e8-hosts-file\") pod \"node-resolver-4cvp2\" (UID: \"56960201-977c-4199-ae5c-609f7b8e79e8\") " pod="openshift-dns/node-resolver-4cvp2" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516890 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56960201-977c-4199-ae5c-609f7b8e79e8-tmp-dir\") pod \"node-resolver-4cvp2\" (UID: \"56960201-977c-4199-ae5c-609f7b8e79e8\") " pod="openshift-dns/node-resolver-4cvp2" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516921 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56960201-977c-4199-ae5c-609f7b8e79e8-hosts-file\") pod \"node-resolver-4cvp2\" (UID: \"56960201-977c-4199-ae5c-609f7b8e79e8\") " pod="openshift-dns/node-resolver-4cvp2" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516939 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-sysctl-d\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.516971 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517085 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517135 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-var-lib-cni-multus\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517492 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517163 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvb2r\" (UniqueName: \"kubernetes.io/projected/f129dca4-c3bb-40b4-96ce-1c13165d56b9-kube-api-access-tvb2r\") pod \"node-ca-fpxss\" (UID: \"f129dca4-c3bb-40b4-96ce-1c13165d56b9\") " pod="openshift-image-registry/node-ca-fpxss" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517192 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-cni-dir\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517218 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-modprobe-d\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517241 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-sysconfig\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517264 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87bxw\" (UniqueName: \"kubernetes.io/projected/56960201-977c-4199-ae5c-609f7b8e79e8-kube-api-access-87bxw\") pod \"node-resolver-4cvp2\" (UID: \"56960201-977c-4199-ae5c-609f7b8e79e8\") " pod="openshift-dns/node-resolver-4cvp2" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517290 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-var-lib-kubelet\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517306 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56960201-977c-4199-ae5c-609f7b8e79e8-tmp-dir\") pod \"node-resolver-4cvp2\" (UID: \"56960201-977c-4199-ae5c-609f7b8e79e8\") " pod="openshift-dns/node-resolver-4cvp2" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517315 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-etc-kubernetes\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517345 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-var-lib-cni-bin\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517374 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-os-release\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517400 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517414 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-sysconfig\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517426 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd7c2\" (UniqueName: \"kubernetes.io/projected/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-kube-api-access-zd7c2\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517451 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/708e0235-4105-4330-8214-b1a1c563c231-tmp\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517458 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-var-lib-cni-multus\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517474 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-system-cni-dir\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517534 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-run-netns\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.517978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517542 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517584 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-var-lib-kubelet\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517583 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517604 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-run-netns\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517630 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-var-lib-kubelet\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517635 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-cni-dir\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517670 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-conf-dir\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517698 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-modprobe-d\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517698 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-systemd\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517706 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-os-release\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517720 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-host\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517737 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-etc-systemd\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517755 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-var-lib-kubelet\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517767 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-multus-conf-dir\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517778 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/708e0235-4105-4330-8214-b1a1c563c231-host\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517799 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-etc-kubernetes\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517837 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-host-var-lib-cni-bin\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.517891 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67fb3091-553a-40ed-bd3e-aad25bd36051-system-cni-dir\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.518713 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.518190 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.519465 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.518743 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/708e0235-4105-4330-8214-b1a1c563c231-etc-tuned\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.520214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.520194 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/708e0235-4105-4330-8214-b1a1c563c231-tmp\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.526906 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.526854 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:57:00.526906 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.526878 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:57:00.526906 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.526892 2548 projected.go:196] Error preparing data for projected volume kube-api-access-54lts for pod openshift-network-diagnostics/network-check-target-rfltr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:00.527111 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.526970 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts podName:bc894046-889c-47dd-989e-d8d4cf0d3114 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:01.026952317 +0000 UTC m=+3.083289845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-54lts" (UniqueName: "kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts") pod "network-check-target-rfltr" (UID: "bc894046-889c-47dd-989e-d8d4cf0d3114") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:00.529037 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.529011 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trnk7\" (UniqueName: \"kubernetes.io/projected/708e0235-4105-4330-8214-b1a1c563c231-kube-api-access-trnk7\") pod \"tuned-dzqfp\" (UID: \"708e0235-4105-4330-8214-b1a1c563c231\") " pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.531471 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.531450 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvb2r\" (UniqueName: \"kubernetes.io/projected/f129dca4-c3bb-40b4-96ce-1c13165d56b9-kube-api-access-tvb2r\") pod \"node-ca-fpxss\" (UID: \"f129dca4-c3bb-40b4-96ce-1c13165d56b9\") " pod="openshift-image-registry/node-ca-fpxss" Jul 18 00:57:00.535596 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.535576 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd7c2\" (UniqueName: \"kubernetes.io/projected/b2c9c9d1-8d69-48ab-9569-4ee8760189d3-kube-api-access-zd7c2\") pod \"multus-additional-cni-plugins-vmhnr\" (UID: \"b2c9c9d1-8d69-48ab-9569-4ee8760189d3\") " pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.536275 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.536249 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87bxw\" (UniqueName: \"kubernetes.io/projected/56960201-977c-4199-ae5c-609f7b8e79e8-kube-api-access-87bxw\") pod \"node-resolver-4cvp2\" (UID: \"56960201-977c-4199-ae5c-609f7b8e79e8\") " pod="openshift-dns/node-resolver-4cvp2" Jul 18 00:57:00.536370 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.536354 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpdz2\" (UniqueName: \"kubernetes.io/projected/67fb3091-553a-40ed-bd3e-aad25bd36051-kube-api-access-cpdz2\") pod \"multus-hrn8p\" (UID: \"67fb3091-553a-40ed-bd3e-aad25bd36051\") " pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.605905 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.605866 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:00.618295 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.618259 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" Jul 18 00:57:00.635283 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.635256 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7mljf" Jul 18 00:57:00.643374 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.643345 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hrn8p" Jul 18 00:57:00.651273 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.651249 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:00.658268 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.658242 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" Jul 18 00:57:00.675033 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.675005 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4cvp2" Jul 18 00:57:00.684035 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.684010 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fpxss" Jul 18 00:57:00.689967 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.689949 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" Jul 18 00:57:00.921115 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:00.921010 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:00.921275 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.921190 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:00.921275 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:00.921270 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs podName:2a03b934-a48a-4a2d-a72c-11faf54565e1 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:01.921249197 +0000 UTC m=+3.977586730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs") pod "network-metrics-daemon-tsk8r" (UID: "2a03b934-a48a-4a2d-a72c-11faf54565e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:01.022230 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:01.022190 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:01.022421 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:01.022344 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:01.022421 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:01.022411 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret podName:db80b378-dd0f-4823-83b6-f7b2596fa989 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:02.0223944 +0000 UTC m=+4.078731912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret") pod "global-pull-secret-syncer-cggnq" (UID: "db80b378-dd0f-4823-83b6-f7b2596fa989") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:01.123556 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:01.123521 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54lts\" (UniqueName: \"kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts\") pod \"network-check-target-rfltr\" (UID: \"bc894046-889c-47dd-989e-d8d4cf0d3114\") " pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:01.123727 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:01.123650 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:57:01.123727 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:01.123667 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:57:01.123727 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:01.123678 2548 projected.go:196] Error preparing data for projected volume kube-api-access-54lts for pod openshift-network-diagnostics/network-check-target-rfltr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:01.123727 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:01.123728 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts podName:bc894046-889c-47dd-989e-d8d4cf0d3114 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:02.123714581 +0000 UTC m=+4.180052106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-54lts" (UniqueName: "kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts") pod "network-check-target-rfltr" (UID: "bc894046-889c-47dd-989e-d8d4cf0d3114") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:01.346735 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:01.346673 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:52:01 +0000 UTC" deadline="2027-12-12 22:47:52.597673524 +0000 UTC" Jul 18 00:57:01.346735 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:01.346733 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12309h50m51.25094671s" Jul 18 00:57:01.472988 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:01.472952 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:01.473186 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:01.473088 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:01.616717 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:57:01.616657 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3930b07b_fdef_4e96_822b_ef433209ee78.slice/crio-e352438c8d450e71966bcfddf082e964226385f1bf4ab71ca7e105f7ad999f93 WatchSource:0}: Error finding container e352438c8d450e71966bcfddf082e964226385f1bf4ab71ca7e105f7ad999f93: Status 404 returned error can't find the container with id e352438c8d450e71966bcfddf082e964226385f1bf4ab71ca7e105f7ad999f93 Jul 18 00:57:01.618598 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:57:01.618478 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67fb3091_553a_40ed_bd3e_aad25bd36051.slice/crio-576e47fa0a769a38d8366bd84144b3efe74a5281cb196aedd319d174e2ddf49c WatchSource:0}: Error finding container 576e47fa0a769a38d8366bd84144b3efe74a5281cb196aedd319d174e2ddf49c: Status 404 returned error can't find the container with id 576e47fa0a769a38d8366bd84144b3efe74a5281cb196aedd319d174e2ddf49c Jul 18 00:57:01.931745 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:01.931530 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:01.931848 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:01.931680 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:01.931886 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:01.931863 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs podName:2a03b934-a48a-4a2d-a72c-11faf54565e1 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:03.93184627 +0000 UTC m=+5.988183802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs") pod "network-metrics-daemon-tsk8r" (UID: "2a03b934-a48a-4a2d-a72c-11faf54565e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:02.032121 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.032081 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:02.032281 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:02.032249 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:02.032342 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:02.032330 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret podName:db80b378-dd0f-4823-83b6-f7b2596fa989 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:04.032305978 +0000 UTC m=+6.088643511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret") pod "global-pull-secret-syncer-cggnq" (UID: "db80b378-dd0f-4823-83b6-f7b2596fa989") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:02.134258 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.133552 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54lts\" (UniqueName: \"kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts\") pod \"network-check-target-rfltr\" (UID: \"bc894046-889c-47dd-989e-d8d4cf0d3114\") " pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:02.134258 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:02.133756 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:57:02.134258 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:02.133779 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:57:02.134258 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:02.133789 2548 projected.go:196] Error preparing data for projected volume kube-api-access-54lts for pod openshift-network-diagnostics/network-check-target-rfltr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:02.134258 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:02.133853 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts podName:bc894046-889c-47dd-989e-d8d4cf0d3114 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:04.133834349 +0000 UTC m=+6.190171888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-54lts" (UniqueName: "kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts") pod "network-check-target-rfltr" (UID: "bc894046-889c-47dd-989e-d8d4cf0d3114") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:02.346983 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.346917 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:52:01 +0000 UTC" deadline="2028-01-13 09:33:35.079619499 +0000 UTC" Jul 18 00:57:02.346983 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.346982 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13064h36m32.732642163s" Jul 18 00:57:02.473847 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.473275 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:02.473847 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:02.473419 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:02.474334 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.474179 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:02.474334 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:02.474286 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:02.493373 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.492805 2548 generic.go:356] "Generic (PLEG): container finished" podID="15380bb3effd40c7d9e614160047b48f" containerID="1e583f9fb8a2a1e5dc081c9131801813cc51ea2599060610aeefd4034a019e15" exitCode=0 Jul 18 00:57:02.493373 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.492890 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" event={"ID":"15380bb3effd40c7d9e614160047b48f","Type":"ContainerDied","Data":"1e583f9fb8a2a1e5dc081c9131801813cc51ea2599060610aeefd4034a019e15"} Jul 18 00:57:02.498602 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.498348 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fpxss" event={"ID":"f129dca4-c3bb-40b4-96ce-1c13165d56b9","Type":"ContainerStarted","Data":"c821045b4a57534fee063c24e4db0279f0b32ea8544d00b22bee317a20849d29"} Jul 18 00:57:02.508255 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.508167 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4cvp2" event={"ID":"56960201-977c-4199-ae5c-609f7b8e79e8","Type":"ContainerStarted","Data":"576c275d35c676b4b8a550fed81d5b3955fb07ff40e33698597b355b4cc34d37"} Jul 18 00:57:02.527560 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.527479 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gzsm5" event={"ID":"bced967c-ed04-4dbe-bdbf-c631f9c7d849","Type":"ContainerStarted","Data":"48173de205c699321896f5de3941eeb32a112d7626fba0d97948ab28336167f3"} Jul 18 00:57:02.532238 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.532128 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7mljf" event={"ID":"4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f","Type":"ContainerStarted","Data":"1f74d9c751248e9fc9380b30ac41cbd3d079dfde3fe7433114e72fea7224574d"} Jul 18 00:57:02.544798 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.544732 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hrn8p" event={"ID":"67fb3091-553a-40ed-bd3e-aad25bd36051","Type":"ContainerStarted","Data":"576e47fa0a769a38d8366bd84144b3efe74a5281cb196aedd319d174e2ddf49c"} Jul 18 00:57:02.558649 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.558551 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-116.ec2.internal" event={"ID":"52b0e16400b201ca7843df9c2c64cd1a","Type":"ContainerStarted","Data":"0210b1dcfe306e18056b9a78410433f073783cd9e6a0f3db5dc7fcf5797ef918"} Jul 18 00:57:02.568326 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.568250 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" event={"ID":"b2c9c9d1-8d69-48ab-9569-4ee8760189d3","Type":"ContainerStarted","Data":"89174707b236efa9a24889dad47da4a50a1274999d4fb923fe54208bcb99ac22"} Jul 18 00:57:02.575036 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.573943 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-116.ec2.internal" podStartSLOduration=2.5739250030000003 podStartE2EDuration="2.573925003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:02.573696224 +0000 UTC m=+4.630033760" watchObservedRunningTime="2026-07-18 00:57:02.573925003 +0000 UTC m=+4.630262540" Jul 18 00:57:02.578204 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.578164 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" event={"ID":"630ff042-40db-46b6-932b-0f9397699eeb","Type":"ContainerStarted","Data":"790f99d727fc351936187c0ab4122d7cf9cf26fe2817e0c41815d9aaa1b11f41"} Jul 18 00:57:02.592836 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.592805 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" event={"ID":"708e0235-4105-4330-8214-b1a1c563c231","Type":"ContainerStarted","Data":"55e7014cd363576f2626c7cf724ce709da87a4a84cf49a7108955e6f4118ffa4"} Jul 18 00:57:02.610049 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:02.610015 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" event={"ID":"3930b07b-fdef-4e96-822b-ef433209ee78","Type":"ContainerStarted","Data":"e352438c8d450e71966bcfddf082e964226385f1bf4ab71ca7e105f7ad999f93"} Jul 18 00:57:03.472857 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:03.472331 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:03.472857 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:03.472467 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:03.631709 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:03.631327 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" event={"ID":"15380bb3effd40c7d9e614160047b48f","Type":"ContainerStarted","Data":"5a019dc67338bde7b827dfe7da7428ea9ec65b4fd4364853c2fbe0833655a316"} Jul 18 00:57:03.948907 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:03.948841 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:03.949132 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:03.949031 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:03.949132 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:03.949095 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs podName:2a03b934-a48a-4a2d-a72c-11faf54565e1 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:07.949077835 +0000 UTC m=+10.005415363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs") pod "network-metrics-daemon-tsk8r" (UID: "2a03b934-a48a-4a2d-a72c-11faf54565e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:04.049798 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:04.049754 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:04.049990 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:04.049958 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:04.050057 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:04.050024 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret podName:db80b378-dd0f-4823-83b6-f7b2596fa989 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:08.050005283 +0000 UTC m=+10.106342817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret") pod "global-pull-secret-syncer-cggnq" (UID: "db80b378-dd0f-4823-83b6-f7b2596fa989") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:04.151200 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:04.151150 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54lts\" (UniqueName: \"kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts\") pod \"network-check-target-rfltr\" (UID: \"bc894046-889c-47dd-989e-d8d4cf0d3114\") " pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:04.151410 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:04.151355 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:57:04.151410 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:04.151389 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:57:04.151410 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:04.151403 2548 projected.go:196] Error preparing data for projected volume kube-api-access-54lts for pod openshift-network-diagnostics/network-check-target-rfltr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:04.151624 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:04.151473 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts podName:bc894046-889c-47dd-989e-d8d4cf0d3114 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:08.151448313 +0000 UTC m=+10.207785878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-54lts" (UniqueName: "kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts") pod "network-check-target-rfltr" (UID: "bc894046-889c-47dd-989e-d8d4cf0d3114") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:04.475136 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:04.474405 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:04.475136 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:04.474552 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:04.475136 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:04.474931 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:04.475136 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:04.475019 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:05.472865 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:05.472826 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:05.473058 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:05.472969 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:06.476029 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:06.475312 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:06.476029 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:06.475444 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:06.476029 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:06.475853 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:06.476029 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:06.475971 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:07.472891 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:07.472426 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:07.472891 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:07.472563 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:07.985130 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:07.985081 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:07.985616 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:07.985284 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:07.985616 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:07.985356 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs podName:2a03b934-a48a-4a2d-a72c-11faf54565e1 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:15.98533506 +0000 UTC m=+18.041672576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs") pod "network-metrics-daemon-tsk8r" (UID: "2a03b934-a48a-4a2d-a72c-11faf54565e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:08.086953 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:08.086363 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:08.086953 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:08.086546 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:08.086953 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:08.086607 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret podName:db80b378-dd0f-4823-83b6-f7b2596fa989 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:16.086590243 +0000 UTC m=+18.142927754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret") pod "global-pull-secret-syncer-cggnq" (UID: "db80b378-dd0f-4823-83b6-f7b2596fa989") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:08.187188 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:08.187145 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54lts\" (UniqueName: \"kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts\") pod \"network-check-target-rfltr\" (UID: \"bc894046-889c-47dd-989e-d8d4cf0d3114\") " pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:08.187382 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:08.187370 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:57:08.187450 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:08.187392 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:57:08.187450 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:08.187407 2548 projected.go:196] Error preparing data for projected volume kube-api-access-54lts for pod openshift-network-diagnostics/network-check-target-rfltr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:08.187544 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:08.187469 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts podName:bc894046-889c-47dd-989e-d8d4cf0d3114 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:16.18744898 +0000 UTC m=+18.243786491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-54lts" (UniqueName: "kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts") pod "network-check-target-rfltr" (UID: "bc894046-889c-47dd-989e-d8d4cf0d3114") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:08.473677 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:08.473165 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:08.473677 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:08.473316 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:08.473936 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:08.473789 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:08.473936 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:08.473886 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:09.472450 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:09.472409 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:09.472907 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:09.472577 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:10.473317 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:10.473281 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:10.473711 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:10.473413 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:10.473711 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:10.473432 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:10.473711 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:10.473526 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:11.472139 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:11.472094 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:11.472322 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:11.472249 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:12.472967 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:12.472486 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:12.472967 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:12.472646 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:12.472967 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:12.472715 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:12.472967 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:12.472831 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:13.472173 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:13.472137 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:13.472317 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:13.472268 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:14.472646 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:14.472608 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:14.473116 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:14.472747 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:14.473116 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:14.472809 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:14.473116 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:14.472923 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:15.472656 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:15.472627 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:15.473067 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:15.472732 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:16.047593 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:16.047555 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:16.047787 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:16.047703 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:16.047787 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:16.047775 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs podName:2a03b934-a48a-4a2d-a72c-11faf54565e1 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:32.047754568 +0000 UTC m=+34.104092091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs") pod "network-metrics-daemon-tsk8r" (UID: "2a03b934-a48a-4a2d-a72c-11faf54565e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:16.148354 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:16.148311 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:16.148516 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:16.148491 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:16.148632 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:16.148556 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret podName:db80b378-dd0f-4823-83b6-f7b2596fa989 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:32.148539326 +0000 UTC m=+34.204876855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret") pod "global-pull-secret-syncer-cggnq" (UID: "db80b378-dd0f-4823-83b6-f7b2596fa989") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:16.249604 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:16.249576 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54lts\" (UniqueName: \"kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts\") pod \"network-check-target-rfltr\" (UID: \"bc894046-889c-47dd-989e-d8d4cf0d3114\") " pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:16.249782 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:16.249737 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:57:16.249782 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:16.249762 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:57:16.249782 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:16.249775 2548 projected.go:196] Error preparing data for projected volume kube-api-access-54lts for pod openshift-network-diagnostics/network-check-target-rfltr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:16.249924 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:16.249840 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts podName:bc894046-889c-47dd-989e-d8d4cf0d3114 nodeName:}" failed. No retries permitted until 2026-07-18 00:57:32.249819689 +0000 UTC m=+34.306157210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-54lts" (UniqueName: "kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts") pod "network-check-target-rfltr" (UID: "bc894046-889c-47dd-989e-d8d4cf0d3114") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:16.472563 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:16.472535 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:16.472750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:16.472548 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:16.472750 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:16.472662 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:16.472750 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:16.472735 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:17.472962 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:17.472931 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:17.473375 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:17.473034 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:18.473791 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:18.473750 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:18.474247 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:18.473844 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:18.474247 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:18.473906 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:18.474247 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:18.473977 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:19.472116 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:19.472068 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:19.472283 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:19.472210 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:20.472998 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:20.472964 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:20.473614 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:20.473117 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:20.473614 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:20.473184 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:20.473614 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:20.473280 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:21.472488 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.472462 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:21.472627 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:21.472597 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:21.674068 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.673868 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" event={"ID":"b2c9c9d1-8d69-48ab-9569-4ee8760189d3","Type":"ContainerStarted","Data":"2f3007929b1b2fe80c4043bd8f891b7c4f06b05ec0421fa6f134ef0db4f8da5f"} Jul 18 00:57:21.676058 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.676032 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" event={"ID":"630ff042-40db-46b6-932b-0f9397699eeb","Type":"ContainerStarted","Data":"5dcfd5c00012b8145255ded946be17917fd4e72fd39e577e90180c1d15f60fd7"} Jul 18 00:57:21.677405 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.677386 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" event={"ID":"708e0235-4105-4330-8214-b1a1c563c231","Type":"ContainerStarted","Data":"80f22b07cbfd59069b8af8d5cd4aea292d806a7d9b1cc081f6bcbda2fdb2df77"} Jul 18 00:57:21.680276 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.680254 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fpxss" event={"ID":"f129dca4-c3bb-40b4-96ce-1c13165d56b9","Type":"ContainerStarted","Data":"2e514cb768d90519f1238eccb333e144f1888b599181cba6b9c9ccb493b0ea81"} Jul 18 00:57:21.682968 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.682940 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4cvp2" event={"ID":"56960201-977c-4199-ae5c-609f7b8e79e8","Type":"ContainerStarted","Data":"00d0ac161b2a627a2c3daf7d71702152975fe8c97ae0c106986260d9b25a161c"} Jul 18 00:57:21.684535 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.684508 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gzsm5" event={"ID":"bced967c-ed04-4dbe-bdbf-c631f9c7d849","Type":"ContainerStarted","Data":"f94824880eb48b23a64ea57c335babd5fb825a3a3fd4e15bfc8f041141d1518f"} Jul 18 00:57:21.698501 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.698435 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-116.ec2.internal" podStartSLOduration=21.698422355 podStartE2EDuration="21.698422355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:03.651034208 +0000 UTC m=+5.707371744" watchObservedRunningTime="2026-07-18 00:57:21.698422355 +0000 UTC m=+23.754759885" Jul 18 00:57:21.714278 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.714222 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dzqfp" podStartSLOduration=2.955866012 podStartE2EDuration="22.714202134s" totalImagesPullingTime="19.758336122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:21.713390898 +0000 UTC m=+23.769728431" watchObservedRunningTime="2026-07-18 00:57:21.714202134 +0000 UTC m=+23.770539666" Jul 18 00:57:21.729190 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.729148 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4cvp2" podStartSLOduration=2.9901049410000002 podStartE2EDuration="22.729133191s" totalImagesPullingTime="19.73902825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:21.728889616 +0000 UTC m=+23.785227151" watchObservedRunningTime="2026-07-18 00:57:21.729133191 +0000 UTC m=+23.785470723" Jul 18 00:57:21.745271 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.745072 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gzsm5" podStartSLOduration=11.452356481 podStartE2EDuration="22.745057803s" totalImagesPullingTime="11.292701322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:21.744494773 +0000 UTC m=+23.800832303" watchObservedRunningTime="2026-07-18 00:57:21.745057803 +0000 UTC m=+23.801395333" Jul 18 00:57:21.758640 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:21.758599 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fpxss" podStartSLOduration=3.004024005 podStartE2EDuration="22.758586716s" totalImagesPullingTime="19.754562711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:21.75852804 +0000 UTC m=+23.814865572" watchObservedRunningTime="2026-07-18 00:57:21.758586716 +0000 UTC m=+23.814924247" Jul 18 00:57:22.472276 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.472105 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:22.472362 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.472171 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:22.472419 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:22.472375 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:22.472479 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:22.472432 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:22.564263 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.564239 2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 18 00:57:22.687898 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.687864 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hrn8p" event={"ID":"67fb3091-553a-40ed-bd3e-aad25bd36051","Type":"ContainerStarted","Data":"3fe3d2e54800dc724cb9cfcabda271e6d427f41a8ef383910c7a7ec41bd988cf"} Jul 18 00:57:22.689284 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.689262 2548 generic.go:356] "Generic (PLEG): container finished" podID="b2c9c9d1-8d69-48ab-9569-4ee8760189d3" containerID="2f3007929b1b2fe80c4043bd8f891b7c4f06b05ec0421fa6f134ef0db4f8da5f" exitCode=0 Jul 18 00:57:22.689368 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.689330 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" event={"ID":"b2c9c9d1-8d69-48ab-9569-4ee8760189d3","Type":"ContainerDied","Data":"2f3007929b1b2fe80c4043bd8f891b7c4f06b05ec0421fa6f134ef0db4f8da5f"} Jul 18 00:57:22.693061 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.693039 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" event={"ID":"630ff042-40db-46b6-932b-0f9397699eeb","Type":"ContainerStarted","Data":"06106bd6100a3ac8fd1a4490fb9606d2d37734b77c4fff85a96f179b6c986f4c"} Jul 18 00:57:22.696048 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.696030 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovn-acl-logging/0.log" Jul 18 00:57:22.696383 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.696365 2548 generic.go:356] "Generic (PLEG): container finished" podID="3930b07b-fdef-4e96-822b-ef433209ee78" containerID="68c35511bed13e6f815205cafb1e86f3dde1093a7ad7fa5efe1d15e04d516231" exitCode=1 Jul 18 00:57:22.696465 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.696447 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" event={"ID":"3930b07b-fdef-4e96-822b-ef433209ee78","Type":"ContainerStarted","Data":"150c374fe1d221a6768b9e830e06d62580e6fb6a22c18688c22f5bce701e7e02"} Jul 18 00:57:22.696523 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.696509 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" event={"ID":"3930b07b-fdef-4e96-822b-ef433209ee78","Type":"ContainerStarted","Data":"52aa88e175449e5678da9b2e19332da4822b931c7e87020e09d8350042884de1"} Jul 18 00:57:22.696564 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.696540 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" event={"ID":"3930b07b-fdef-4e96-822b-ef433209ee78","Type":"ContainerStarted","Data":"5d566bef757280101b95fa36e2b491431faf7e22c213fc316888429747711314"} Jul 18 00:57:22.696609 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.696569 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" event={"ID":"3930b07b-fdef-4e96-822b-ef433209ee78","Type":"ContainerStarted","Data":"a215a78581a493adfde279b537916a4834129f797e11599d8581cc54ff8e720b"} Jul 18 00:57:22.696609 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.696598 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" event={"ID":"3930b07b-fdef-4e96-822b-ef433209ee78","Type":"ContainerStarted","Data":"ff81d8b05467e1e5be0984c7878e52c8c36a644dcda5f3f1ba3b36a8d6439446"} Jul 18 00:57:22.696710 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.696624 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" event={"ID":"3930b07b-fdef-4e96-822b-ef433209ee78","Type":"ContainerDied","Data":"68c35511bed13e6f815205cafb1e86f3dde1093a7ad7fa5efe1d15e04d516231"} Jul 18 00:57:22.706967 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:22.706929 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hrn8p" podStartSLOduration=3.926501455 podStartE2EDuration="23.706918642s" totalImagesPullingTime="19.780417187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:22.706454295 +0000 UTC m=+24.762791822" watchObservedRunningTime="2026-07-18 00:57:22.706918642 +0000 UTC m=+24.763256213" Jul 18 00:57:23.141311 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:23.141223 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:23.141730 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:23.141708 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:23.372129 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:23.371954 2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T00:57:22.564259131Z","UUID":"00749325-efef-4e5e-bf9f-4e1ee09b7899","Handler":null,"Name":"","Endpoint":""} Jul 18 00:57:23.373598 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:23.373569 2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 18 00:57:23.373736 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:23.373614 2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 18 00:57:23.473065 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:23.473040 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:23.473215 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:23.473157 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:23.699832 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:23.699799 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7mljf" event={"ID":"4c806a34-ce3b-4fb9-b7e1-31dd43f14b6f","Type":"ContainerStarted","Data":"60082317e54c0749dddf42af05de7726e614fabfa5de5936ce49879ef697b8d5"} Jul 18 00:57:23.700350 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:23.700328 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:23.700696 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:23.700678 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gzsm5" Jul 18 00:57:23.714812 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:23.714759 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7mljf" podStartSLOduration=4.952297144 podStartE2EDuration="24.714739964s" totalImagesPullingTime="19.76244282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:23.714537839 +0000 UTC m=+25.770875370" watchObservedRunningTime="2026-07-18 00:57:23.714739964 +0000 UTC m=+25.771077496" Jul 18 00:57:24.472609 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:24.472438 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:24.472752 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:24.472442 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:24.472752 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:24.472681 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:24.472834 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:24.472752 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:24.704208 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:24.703941 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" event={"ID":"630ff042-40db-46b6-932b-0f9397699eeb","Type":"ContainerStarted","Data":"f8adf0146ee64af986e5fd155d3abfd76ab48f7ce587e2e192a2e9cb8b2df6c8"} Jul 18 00:57:24.707457 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:24.707434 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovn-acl-logging/0.log" Jul 18 00:57:24.707959 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:24.707925 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" event={"ID":"3930b07b-fdef-4e96-822b-ef433209ee78","Type":"ContainerStarted","Data":"316e1b5d388f44417cc94b8a55120fc026b149122de693ee2f8a09c920606397"} Jul 18 00:57:25.473083 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:25.473051 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:25.473307 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:25.473176 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:26.264731 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:26.264646 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4cvp2_56960201-977c-4199-ae5c-609f7b8e79e8/dns-node-resolver/0.log" Jul 18 00:57:26.472774 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:26.472597 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:26.472928 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:26.472665 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:26.472928 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:26.472852 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:26.473029 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:26.472941 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:26.717069 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:26.717039 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovn-acl-logging/0.log" Jul 18 00:57:26.717522 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:26.717496 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" event={"ID":"3930b07b-fdef-4e96-822b-ef433209ee78","Type":"ContainerStarted","Data":"1f7b7ecb055121ed78761e7ff0d7183860848b64fcf498cfd4e133ba1410b921"} Jul 18 00:57:26.717786 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:26.717764 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:26.717967 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:26.717952 2548 scope.go:117] "RemoveContainer" containerID="68c35511bed13e6f815205cafb1e86f3dde1093a7ad7fa5efe1d15e04d516231" Jul 18 00:57:26.734652 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:26.734627 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:26.749593 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:26.749555 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbhmx" podStartSLOduration=6.091358874 podStartE2EDuration="27.749540261s" totalImagesPullingTime="21.658181387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:24.7214142 +0000 UTC m=+26.777751732" watchObservedRunningTime="2026-07-18 00:57:26.749540261 +0000 UTC m=+28.805877774" Jul 18 00:57:27.446942 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:27.446912 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fpxss_f129dca4-c3bb-40b4-96ce-1c13165d56b9/node-ca/0.log" Jul 18 00:57:27.472280 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:27.472256 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:27.472427 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:27.472375 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:28.473615 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.473583 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:28.474035 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:28.473699 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:28.474035 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.473747 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:28.474035 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:28.473843 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:28.507521 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.507497 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rfltr"] Jul 18 00:57:28.510458 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.510431 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cggnq"] Jul 18 00:57:28.510580 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.510545 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:28.510676 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:28.510650 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:28.511305 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.511283 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tsk8r"] Jul 18 00:57:28.723559 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.723532 2548 generic.go:356] "Generic (PLEG): container finished" podID="b2c9c9d1-8d69-48ab-9569-4ee8760189d3" containerID="368393f2e3f859ee3c4e7a78323687026c1a621cf84a8114b92b7ec99be4242a" exitCode=0 Jul 18 00:57:28.723727 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.723628 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" event={"ID":"b2c9c9d1-8d69-48ab-9569-4ee8760189d3","Type":"ContainerDied","Data":"368393f2e3f859ee3c4e7a78323687026c1a621cf84a8114b92b7ec99be4242a"} Jul 18 00:57:28.727445 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.727427 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovn-acl-logging/0.log" Jul 18 00:57:28.727864 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.727824 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" event={"ID":"3930b07b-fdef-4e96-822b-ef433209ee78","Type":"ContainerStarted","Data":"48a42fe27429688abfbae0a37e67814739afdb9af89c24a73ce9eb0943e78561"} Jul 18 00:57:28.727864 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.727858 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:28.727979 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.727839 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:28.727979 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:28.727952 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:28.728113 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:28.727988 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:28.728166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.728089 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:28.728166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.728159 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:28.743203 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.743184 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:57:28.772281 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:28.772232 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" podStartSLOduration=9.955536322 podStartE2EDuration="29.772219405s" totalImagesPullingTime="19.816683083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:28.770415884 +0000 UTC m=+30.826753414" watchObservedRunningTime="2026-07-18 00:57:28.772219405 +0000 UTC m=+30.828556935" Jul 18 00:57:30.473221 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:30.473023 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:30.473636 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:30.473023 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:30.473636 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:30.473309 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:30.473636 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:30.473023 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:30.473636 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:30.473354 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:30.473636 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:30.473428 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:30.734594 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:30.734556 2548 generic.go:356] "Generic (PLEG): container finished" podID="b2c9c9d1-8d69-48ab-9569-4ee8760189d3" containerID="e3110d2197a81d6f5591fac119a005ae358039e4303a3e5b1730f78125a4f087" exitCode=0 Jul 18 00:57:30.734752 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:30.734629 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" event={"ID":"b2c9c9d1-8d69-48ab-9569-4ee8760189d3","Type":"ContainerDied","Data":"e3110d2197a81d6f5591fac119a005ae358039e4303a3e5b1730f78125a4f087"} Jul 18 00:57:31.739420 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:31.739388 2548 generic.go:356] "Generic (PLEG): container finished" podID="b2c9c9d1-8d69-48ab-9569-4ee8760189d3" containerID="88b35cfa263ff7bdd5fb877768a69d5121a269f4765c027bcece8cca369d71f3" exitCode=0 Jul 18 00:57:31.740062 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:31.739457 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" event={"ID":"b2c9c9d1-8d69-48ab-9569-4ee8760189d3","Type":"ContainerDied","Data":"88b35cfa263ff7bdd5fb877768a69d5121a269f4765c027bcece8cca369d71f3"} Jul 18 00:57:32.072332 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:32.072257 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:32.072514 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:32.072402 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:32.072514 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:32.072455 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs podName:2a03b934-a48a-4a2d-a72c-11faf54565e1 nodeName:}" failed. No retries permitted until 2026-07-18 00:58:04.072441124 +0000 UTC m=+66.128778646 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs") pod "network-metrics-daemon-tsk8r" (UID: "2a03b934-a48a-4a2d-a72c-11faf54565e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:57:32.172628 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:32.172584 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:32.172792 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:32.172692 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:32.172792 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:32.172758 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret podName:db80b378-dd0f-4823-83b6-f7b2596fa989 nodeName:}" failed. No retries permitted until 2026-07-18 00:58:04.172739555 +0000 UTC m=+66.229077078 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret") pod "global-pull-secret-syncer-cggnq" (UID: "db80b378-dd0f-4823-83b6-f7b2596fa989") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:57:32.273368 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:32.273325 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54lts\" (UniqueName: \"kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts\") pod \"network-check-target-rfltr\" (UID: \"bc894046-889c-47dd-989e-d8d4cf0d3114\") " pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:32.273533 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:32.273485 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:57:32.273533 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:32.273504 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:57:32.273533 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:32.273515 2548 projected.go:196] Error preparing data for projected volume kube-api-access-54lts for pod openshift-network-diagnostics/network-check-target-rfltr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:32.273702 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:32.273580 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts podName:bc894046-889c-47dd-989e-d8d4cf0d3114 nodeName:}" failed. No retries permitted until 2026-07-18 00:58:04.273565134 +0000 UTC m=+66.329902645 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-54lts" (UniqueName: "kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts") pod "network-check-target-rfltr" (UID: "bc894046-889c-47dd-989e-d8d4cf0d3114") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:57:32.472609 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:32.472575 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:32.472795 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:32.472636 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:32.472795 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:32.472720 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:32.472914 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:32.472832 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:32.472992 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:32.472939 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:32.473146 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:32.473080 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:34.473245 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:34.473205 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:34.473833 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:34.473696 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:34.474147 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:34.474119 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:34.474280 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:34.474244 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:34.474348 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:34.474325 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:34.474436 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:34.474417 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:36.472946 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:36.472916 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:36.472946 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:36.472936 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:36.473351 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:36.472936 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:36.473351 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:36.473046 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:36.473351 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:36.473112 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:36.473351 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:36.473163 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:36.753945 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:36.753873 2548 generic.go:356] "Generic (PLEG): container finished" podID="b2c9c9d1-8d69-48ab-9569-4ee8760189d3" containerID="ed69af98d89d240a36d83185e1728a2d5dbf82acddfef579d218555004701c51" exitCode=0 Jul 18 00:57:36.753945 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:36.753932 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" event={"ID":"b2c9c9d1-8d69-48ab-9569-4ee8760189d3","Type":"ContainerDied","Data":"ed69af98d89d240a36d83185e1728a2d5dbf82acddfef579d218555004701c51"} Jul 18 00:57:37.761295 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:37.761264 2548 generic.go:356] "Generic (PLEG): container finished" podID="b2c9c9d1-8d69-48ab-9569-4ee8760189d3" containerID="ed79232b76eabc57fc524034722d4299a9a75ecd07354b99c075693a7d2ea5c6" exitCode=0 Jul 18 00:57:37.761655 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:37.761314 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" event={"ID":"b2c9c9d1-8d69-48ab-9569-4ee8760189d3","Type":"ContainerDied","Data":"ed79232b76eabc57fc524034722d4299a9a75ecd07354b99c075693a7d2ea5c6"} Jul 18 00:57:38.473556 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:38.473372 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:38.473740 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:38.473458 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:38.473740 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:38.473621 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:38.473740 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:38.473491 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:38.473740 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:38.473727 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:38.473903 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:38.473779 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:38.766742 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:38.766666 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" event={"ID":"b2c9c9d1-8d69-48ab-9569-4ee8760189d3","Type":"ContainerStarted","Data":"df32f373b7961c5452777c4ae0a789081703edf8bd969ee11d31880de7cd49cf"} Jul 18 00:57:38.791804 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:38.791760 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vmhnr" podStartSLOduration=8.658377666 podStartE2EDuration="39.791747355s" totalImagesPullingTime="31.133369689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:38.791294793 +0000 UTC m=+40.847632349" watchObservedRunningTime="2026-07-18 00:57:38.791747355 +0000 UTC m=+40.848084887" Jul 18 00:57:40.472972 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:40.472936 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:40.473416 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:40.473034 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:40.473416 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:40.473057 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:40.473416 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:40.473046 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:40.473416 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:40.473175 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:40.473416 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:40.473295 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:42.472258 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:42.472225 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:42.472627 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:42.472225 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:42.472627 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:42.472358 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:42.472627 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:42.472237 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:42.472627 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:42.472417 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:42.472627 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:42.472519 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:44.473069 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:44.473033 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:44.473542 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:44.473157 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:44.473542 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:44.473167 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfltr" podUID="bc894046-889c-47dd-989e-d8d4cf0d3114" Jul 18 00:57:44.473542 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:44.473273 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsk8r" podUID="2a03b934-a48a-4a2d-a72c-11faf54565e1" Jul 18 00:57:44.473542 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:44.473332 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:44.473542 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:57:44.473409 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cggnq" podUID="db80b378-dd0f-4823-83b6-f7b2596fa989" Jul 18 00:57:46.264358 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.264282 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-116.ec2.internal" event="NodeReady" Jul 18 00:57:46.264810 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.264418 2548 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 18 00:57:46.311982 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.311954 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-q7xcl"] Jul 18 00:57:46.319383 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.319363 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g5j2n"] Jul 18 00:57:46.319517 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.319494 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q7xcl" Jul 18 00:57:46.322259 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.322241 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 18 00:57:46.322370 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.322288 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 18 00:57:46.322370 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.322302 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 18 00:57:46.322370 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.322290 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6qvm5\"" Jul 18 00:57:46.325407 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.325376 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q7xcl"] Jul 18 00:57:46.325510 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.325476 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.328167 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.328003 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 18 00:57:46.328167 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.328136 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-24r6v\"" Jul 18 00:57:46.328167 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.328148 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 18 00:57:46.328376 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.328357 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 18 00:57:46.328544 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.328528 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 18 00:57:46.340072 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.340054 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g5j2n"] Jul 18 00:57:46.373968 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.373938 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-crio-socket\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.373968 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.373967 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.374202 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.373986 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.374202 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.374020 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8x57\" (UniqueName: \"kubernetes.io/projected/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-kube-api-access-c8x57\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.374202 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.374073 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9ea6b45-15e9-468b-b258-acffbeedb347-cert\") pod \"ingress-canary-q7xcl\" (UID: \"e9ea6b45-15e9-468b-b258-acffbeedb347\") " pod="openshift-ingress-canary/ingress-canary-q7xcl" Jul 18 00:57:46.374202 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.374142 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjtzf\" (UniqueName: \"kubernetes.io/projected/e9ea6b45-15e9-468b-b258-acffbeedb347-kube-api-access-qjtzf\") pod \"ingress-canary-q7xcl\" (UID: \"e9ea6b45-15e9-468b-b258-acffbeedb347\") " pod="openshift-ingress-canary/ingress-canary-q7xcl" Jul 18 00:57:46.374333 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.374204 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-data-volume\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.409887 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.409859 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4z79s"] Jul 18 00:57:46.422413 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.422385 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.422732 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.422660 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4z79s"] Jul 18 00:57:46.425780 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.425760 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n984r\"" Jul 18 00:57:46.425881 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.425837 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 18 00:57:46.425999 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.425981 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 18 00:57:46.472972 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.472951 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:57:46.472972 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.472960 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:57:46.473200 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.473160 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:57:46.474685 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.474663 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4145ebda-7b42-4bd9-84c1-b6368398cdcf-metrics-tls\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.474775 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.474700 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4145ebda-7b42-4bd9-84c1-b6368398cdcf-tmp-dir\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.474775 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.474729 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-crio-socket\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.474775 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.474757 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.474930 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.474786 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk9rv\" (UniqueName: \"kubernetes.io/projected/4145ebda-7b42-4bd9-84c1-b6368398cdcf-kube-api-access-wk9rv\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.474930 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.474809 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.474930 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.474884 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8x57\" (UniqueName: \"kubernetes.io/projected/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-kube-api-access-c8x57\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.474930 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.474911 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4145ebda-7b42-4bd9-84c1-b6368398cdcf-config-volume\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.474930 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.474920 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-crio-socket\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.475166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.474937 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9ea6b45-15e9-468b-b258-acffbeedb347-cert\") pod \"ingress-canary-q7xcl\" (UID: \"e9ea6b45-15e9-468b-b258-acffbeedb347\") " pod="openshift-ingress-canary/ingress-canary-q7xcl" Jul 18 00:57:46.475166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.474987 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjtzf\" (UniqueName: \"kubernetes.io/projected/e9ea6b45-15e9-468b-b258-acffbeedb347-kube-api-access-qjtzf\") pod \"ingress-canary-q7xcl\" (UID: \"e9ea6b45-15e9-468b-b258-acffbeedb347\") " pod="openshift-ingress-canary/ingress-canary-q7xcl" Jul 18 00:57:46.475166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.475044 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-data-volume\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.475354 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.475335 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-data-volume\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.475426 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.475406 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.475831 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.475815 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 00:57:46.475951 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.475914 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 00:57:46.476037 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.475949 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vk5c6\"" Jul 18 00:57:46.476116 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.475847 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fzzvq\"" Jul 18 00:57:46.476116 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.476080 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 00:57:46.476237 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.475815 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 00:57:46.480040 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.480023 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.480120 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.480078 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9ea6b45-15e9-468b-b258-acffbeedb347-cert\") pod \"ingress-canary-q7xcl\" (UID: \"e9ea6b45-15e9-468b-b258-acffbeedb347\") " pod="openshift-ingress-canary/ingress-canary-q7xcl" Jul 18 00:57:46.482951 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.482924 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8x57\" (UniqueName: \"kubernetes.io/projected/cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa-kube-api-access-c8x57\") pod \"insights-runtime-extractor-g5j2n\" (UID: \"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa\") " pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.483128 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.483111 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjtzf\" (UniqueName: \"kubernetes.io/projected/e9ea6b45-15e9-468b-b258-acffbeedb347-kube-api-access-qjtzf\") pod \"ingress-canary-q7xcl\" (UID: \"e9ea6b45-15e9-468b-b258-acffbeedb347\") " pod="openshift-ingress-canary/ingress-canary-q7xcl" Jul 18 00:57:46.575700 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.575628 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4145ebda-7b42-4bd9-84c1-b6368398cdcf-config-volume\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.575700 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.575689 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4145ebda-7b42-4bd9-84c1-b6368398cdcf-metrics-tls\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.575905 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.575706 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4145ebda-7b42-4bd9-84c1-b6368398cdcf-tmp-dir\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.575905 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.575726 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk9rv\" (UniqueName: \"kubernetes.io/projected/4145ebda-7b42-4bd9-84c1-b6368398cdcf-kube-api-access-wk9rv\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.576173 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.576146 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4145ebda-7b42-4bd9-84c1-b6368398cdcf-tmp-dir\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.576309 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.576292 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4145ebda-7b42-4bd9-84c1-b6368398cdcf-config-volume\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.578146 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.578127 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4145ebda-7b42-4bd9-84c1-b6368398cdcf-metrics-tls\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.583758 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.583739 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk9rv\" (UniqueName: \"kubernetes.io/projected/4145ebda-7b42-4bd9-84c1-b6368398cdcf-kube-api-access-wk9rv\") pod \"dns-default-4z79s\" (UID: \"4145ebda-7b42-4bd9-84c1-b6368398cdcf\") " pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.630636 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.630615 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q7xcl" Jul 18 00:57:46.635789 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.635767 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g5j2n" Jul 18 00:57:46.732366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.732333 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:46.798636 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.798496 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q7xcl"] Jul 18 00:57:46.809268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:57:46.809220 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ea6b45_15e9_468b_b258_acffbeedb347.slice/crio-4c508dfd129df9ca84641b33290b66420080dfcb0e07d204da74e057f6faad2f WatchSource:0}: Error finding container 4c508dfd129df9ca84641b33290b66420080dfcb0e07d204da74e057f6faad2f: Status 404 returned error can't find the container with id 4c508dfd129df9ca84641b33290b66420080dfcb0e07d204da74e057f6faad2f Jul 18 00:57:46.826774 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.826719 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g5j2n"] Jul 18 00:57:46.830201 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:57:46.830169 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe5bbb3_dc8d_46e1_8d8c_76500ba388aa.slice/crio-7adaa01a9cb1886aa40ee5c3ae928b635b637c2db89c5071832ce193c687ea3c WatchSource:0}: Error finding container 7adaa01a9cb1886aa40ee5c3ae928b635b637c2db89c5071832ce193c687ea3c: Status 404 returned error can't find the container with id 7adaa01a9cb1886aa40ee5c3ae928b635b637c2db89c5071832ce193c687ea3c Jul 18 00:57:46.889336 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:46.889308 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4z79s"] Jul 18 00:57:46.891863 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:57:46.891834 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4145ebda_7b42_4bd9_84c1_b6368398cdcf.slice/crio-18ccc913ab76af8544b1ff972ba25c7331b413b6ec7bc6b496f8dea11ea0c0f8 WatchSource:0}: Error finding container 18ccc913ab76af8544b1ff972ba25c7331b413b6ec7bc6b496f8dea11ea0c0f8: Status 404 returned error can't find the container with id 18ccc913ab76af8544b1ff972ba25c7331b413b6ec7bc6b496f8dea11ea0c0f8 Jul 18 00:57:47.793185 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:47.793110 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4z79s" event={"ID":"4145ebda-7b42-4bd9-84c1-b6368398cdcf","Type":"ContainerStarted","Data":"18ccc913ab76af8544b1ff972ba25c7331b413b6ec7bc6b496f8dea11ea0c0f8"} Jul 18 00:57:47.795141 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:47.795007 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g5j2n" event={"ID":"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa","Type":"ContainerStarted","Data":"7adaa01a9cb1886aa40ee5c3ae928b635b637c2db89c5071832ce193c687ea3c"} Jul 18 00:57:47.797606 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:47.797552 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q7xcl" event={"ID":"e9ea6b45-15e9-468b-b258-acffbeedb347","Type":"ContainerStarted","Data":"4c508dfd129df9ca84641b33290b66420080dfcb0e07d204da74e057f6faad2f"} Jul 18 00:57:51.969510 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:51.969446 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd"] Jul 18 00:57:52.225176 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:52.225084 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd"] Jul 18 00:57:52.225306 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:52.225179 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd" Jul 18 00:57:52.229370 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:52.229349 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fgxtb\"" Jul 18 00:57:52.229508 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:52.229351 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 18 00:57:52.319205 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:52.319177 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/25843a1a-e569-42ca-be3e-28282c27b2e0-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-94hgd\" (UID: \"25843a1a-e569-42ca-be3e-28282c27b2e0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd" Jul 18 00:57:52.419807 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:52.419771 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/25843a1a-e569-42ca-be3e-28282c27b2e0-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-94hgd\" (UID: \"25843a1a-e569-42ca-be3e-28282c27b2e0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd" Jul 18 00:57:52.422270 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:52.422243 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/25843a1a-e569-42ca-be3e-28282c27b2e0-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-94hgd\" (UID: \"25843a1a-e569-42ca-be3e-28282c27b2e0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd" Jul 18 00:57:52.534658 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:52.534597 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd" Jul 18 00:57:53.348377 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:53.348308 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd"] Jul 18 00:57:53.818199 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:53.818152 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd" event={"ID":"25843a1a-e569-42ca-be3e-28282c27b2e0","Type":"ContainerStarted","Data":"480f9aec76a36f4f901a35364edeec7c957cc5e3f87401b6abdba577d5e96693"} Jul 18 00:57:53.823061 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:53.823028 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g5j2n" event={"ID":"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa","Type":"ContainerStarted","Data":"b0a7ecb5e5c407bdb29891b280d5c57af2740e8bbfee1b3a45b4a5fd0cc50c2f"} Jul 18 00:57:53.826321 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:53.826290 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q7xcl" event={"ID":"e9ea6b45-15e9-468b-b258-acffbeedb347","Type":"ContainerStarted","Data":"3ac19c34a8cf1f94b3dbea0468c7aafd153c5f595dc538c81a536c630e301149"} Jul 18 00:57:53.829577 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:53.829549 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4z79s" event={"ID":"4145ebda-7b42-4bd9-84c1-b6368398cdcf","Type":"ContainerStarted","Data":"fd7c1ad74aaa7410757a8b3413097fd38c97c354e4b559dcdf9224db58ce0719"} Jul 18 00:57:53.829669 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:53.829601 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4z79s" event={"ID":"4145ebda-7b42-4bd9-84c1-b6368398cdcf","Type":"ContainerStarted","Data":"f1c110b633269c8915d3374928fa6e45f6eaaccf1264bd26bd5b28d7ff71a871"} Jul 18 00:57:53.829772 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:53.829757 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4z79s" Jul 18 00:57:53.843376 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:53.843163 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-q7xcl" podStartSLOduration=1.44441578 podStartE2EDuration="7.843146214s" totalImagesPullingTime="6.398730434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:53.841367818 +0000 UTC m=+55.897705351" watchObservedRunningTime="2026-07-18 00:57:53.843146214 +0000 UTC m=+55.899483724" Jul 18 00:57:53.857904 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:53.857863 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4z79s" podStartSLOduration=1.5377028990000001 podStartE2EDuration="7.857850393s" totalImagesPullingTime="6.320147494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:53.85691023 +0000 UTC m=+55.913247761" watchObservedRunningTime="2026-07-18 00:57:53.857850393 +0000 UTC m=+55.914187924" Jul 18 00:57:54.834439 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:54.834346 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd" event={"ID":"25843a1a-e569-42ca-be3e-28282c27b2e0","Type":"ContainerStarted","Data":"ea1f05f4e9bb7aca406f8d511de0a9f9ea84ef2ce629b86c635d739251467246"} Jul 18 00:57:54.834861 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:54.834813 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd" Jul 18 00:57:54.839776 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:54.839751 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd" Jul 18 00:57:54.849979 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:54.849926 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-94hgd" podStartSLOduration=2.731575382 podStartE2EDuration="3.849908452s" totalImagesPullingTime="1.11833307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:54.849359104 +0000 UTC m=+56.905696637" watchObservedRunningTime="2026-07-18 00:57:54.849908452 +0000 UTC m=+56.906245984" Jul 18 00:57:55.028641 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.028601 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn"] Jul 18 00:57:55.035758 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.035725 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.038314 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.038292 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 18 00:57:55.038498 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.038478 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 18 00:57:55.038686 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.038666 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 18 00:57:55.038951 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.038902 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 18 00:57:55.040638 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.040583 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-467x6\"" Jul 18 00:57:55.040799 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.040780 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 18 00:57:55.041862 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.041841 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn"] Jul 18 00:57:55.141595 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.141519 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c82ad08-33a5-4f23-90ab-b433f97ef71b-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.141595 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.141554 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c82ad08-33a5-4f23-90ab-b433f97ef71b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.141595 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.141586 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvs28\" (UniqueName: \"kubernetes.io/projected/5c82ad08-33a5-4f23-90ab-b433f97ef71b-kube-api-access-fvs28\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.141853 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.141725 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c82ad08-33a5-4f23-90ab-b433f97ef71b-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.242408 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.242365 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c82ad08-33a5-4f23-90ab-b433f97ef71b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.242603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.242423 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvs28\" (UniqueName: \"kubernetes.io/projected/5c82ad08-33a5-4f23-90ab-b433f97ef71b-kube-api-access-fvs28\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.242603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.242516 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c82ad08-33a5-4f23-90ab-b433f97ef71b-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.242603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.242586 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c82ad08-33a5-4f23-90ab-b433f97ef71b-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.243442 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.243390 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c82ad08-33a5-4f23-90ab-b433f97ef71b-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.245164 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.245142 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c82ad08-33a5-4f23-90ab-b433f97ef71b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.245314 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.245294 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c82ad08-33a5-4f23-90ab-b433f97ef71b-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.251784 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.251758 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvs28\" (UniqueName: \"kubernetes.io/projected/5c82ad08-33a5-4f23-90ab-b433f97ef71b-kube-api-access-fvs28\") pod \"prometheus-operator-5945b5cfd-8b7zn\" (UID: \"5c82ad08-33a5-4f23-90ab-b433f97ef71b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:55.346682 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:55.346644 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" Jul 18 00:57:56.757703 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:56.757676 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn"] Jul 18 00:57:56.760511 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:57:56.760472 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c82ad08_33a5_4f23_90ab_b433f97ef71b.slice/crio-8ab80081e461af5da72eebef19bfdcc4564b1c0c25a96d72bfb392c4e1af4509 WatchSource:0}: Error finding container 8ab80081e461af5da72eebef19bfdcc4564b1c0c25a96d72bfb392c4e1af4509: Status 404 returned error can't find the container with id 8ab80081e461af5da72eebef19bfdcc4564b1c0c25a96d72bfb392c4e1af4509 Jul 18 00:57:56.843130 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:56.843075 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" event={"ID":"5c82ad08-33a5-4f23-90ab-b433f97ef71b","Type":"ContainerStarted","Data":"8ab80081e461af5da72eebef19bfdcc4564b1c0c25a96d72bfb392c4e1af4509"} Jul 18 00:57:56.844767 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:56.844744 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g5j2n" event={"ID":"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa","Type":"ContainerStarted","Data":"594c9bd1ab88a78f7e6b953ecd3c2b0e8f9d1cab89e205a20d3dd005fe61d7be"} Jul 18 00:57:58.855830 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:58.855789 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" event={"ID":"5c82ad08-33a5-4f23-90ab-b433f97ef71b","Type":"ContainerStarted","Data":"6fd9ae3033b3225ac1f5d56572f2d8656b0a731c2a51dfe8340067ab65ebe1e9"} Jul 18 00:57:58.856247 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:58.855852 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" event={"ID":"5c82ad08-33a5-4f23-90ab-b433f97ef71b","Type":"ContainerStarted","Data":"bfa1761a5a7d961652f41d3b708b862e36e0b10e1d9b856f8d097fa5935a1e60"} Jul 18 00:57:58.872314 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:57:58.872248 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8b7zn" podStartSLOduration=2.688171835 podStartE2EDuration="3.872228624s" totalImagesPullingTime="1.184056789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:58.872014017 +0000 UTC m=+60.928351558" watchObservedRunningTime="2026-07-18 00:57:58.872228624 +0000 UTC m=+60.928566156" Jul 18 00:58:00.373880 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.373850 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt"] Jul 18 00:58:00.376368 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.376351 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.379180 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.379160 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-59g82\"" Jul 18 00:58:00.379245 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.379210 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 18 00:58:00.379448 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.379431 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 18 00:58:00.390378 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.390358 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt"] Jul 18 00:58:00.397625 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.397604 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lt26n"] Jul 18 00:58:00.399432 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.399417 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-zz58v"] Jul 18 00:58:00.399565 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.399549 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.401159 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.401144 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.402254 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.402238 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 18 00:58:00.402342 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.402273 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 18 00:58:00.402342 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.402285 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jm6m9\"" Jul 18 00:58:00.402342 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.402305 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 18 00:58:00.403756 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.403728 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 18 00:58:00.404067 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.404050 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 18 00:58:00.404787 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.404763 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wmxmr\"" Jul 18 00:58:00.404879 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.404765 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 18 00:58:00.412118 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.412077 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-zz58v"] Jul 18 00:58:00.485373 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485344 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.485503 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485381 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhz8t\" (UniqueName: \"kubernetes.io/projected/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-kube-api-access-mhz8t\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.485503 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485408 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.485503 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485431 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-wtmp\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.485503 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485482 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd8bl\" (UniqueName: \"kubernetes.io/projected/aac263c9-741b-4718-8baa-0eaacb6bed7b-kube-api-access-zd8bl\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.485734 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485510 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.485734 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485530 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aac263c9-741b-4718-8baa-0eaacb6bed7b-root\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.485734 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485548 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.485734 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485578 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.485734 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485597 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.485734 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485616 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.485734 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485632 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aac263c9-741b-4718-8baa-0eaacb6bed7b-metrics-client-ca\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.485734 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485680 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aac263c9-741b-4718-8baa-0eaacb6bed7b-sys\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.485734 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485731 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-textfile\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.486012 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485756 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.486012 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485771 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.486012 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485791 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z6b5\" (UniqueName: \"kubernetes.io/projected/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-api-access-5z6b5\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.486012 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485825 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.486012 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.485854 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-tls\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.586678 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586615 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.586678 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586647 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-tls\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.586678 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586670 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.586911 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586699 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhz8t\" (UniqueName: \"kubernetes.io/projected/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-kube-api-access-mhz8t\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.586911 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586726 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.586911 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586751 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-wtmp\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.586911 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586774 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd8bl\" (UniqueName: \"kubernetes.io/projected/aac263c9-741b-4718-8baa-0eaacb6bed7b-kube-api-access-zd8bl\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.586911 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:58:00.586780 2548 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 18 00:58:00.586911 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586808 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.586911 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:58:00.586846 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-tls podName:aac263c9-741b-4718-8baa-0eaacb6bed7b nodeName:}" failed. No retries permitted until 2026-07-18 00:58:01.08681918 +0000 UTC m=+63.143156742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-tls") pod "node-exporter-lt26n" (UID: "aac263c9-741b-4718-8baa-0eaacb6bed7b") : secret "node-exporter-tls" not found Jul 18 00:58:00.586911 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586872 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aac263c9-741b-4718-8baa-0eaacb6bed7b-root\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.586911 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586892 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586924 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586946 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586963 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.586985 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aac263c9-741b-4718-8baa-0eaacb6bed7b-metrics-client-ca\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587008 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aac263c9-741b-4718-8baa-0eaacb6bed7b-sys\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587053 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-textfile\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587119 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587126 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587146 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587183 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z6b5\" (UniqueName: \"kubernetes.io/projected/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-api-access-5z6b5\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587282 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-wtmp\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.587366 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587283 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aac263c9-741b-4718-8baa-0eaacb6bed7b-root\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.587966 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587395 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.587966 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587550 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aac263c9-741b-4718-8baa-0eaacb6bed7b-sys\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.587966 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587740 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-textfile\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.587966 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.587863 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.588192 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.588028 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aac263c9-741b-4718-8baa-0eaacb6bed7b-metrics-client-ca\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.588552 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.588343 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.588552 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.588364 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.589665 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.589633 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.589930 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.589910 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.590134 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.590115 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.590324 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.590303 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.593962 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.590435 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.596655 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.596637 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd8bl\" (UniqueName: \"kubernetes.io/projected/aac263c9-741b-4718-8baa-0eaacb6bed7b-kube-api-access-zd8bl\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:00.596836 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.596818 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z6b5\" (UniqueName: \"kubernetes.io/projected/9387f2c5-b3ac-40a4-96f0-832d23cbc39c-kube-api-access-5z6b5\") pod \"kube-state-metrics-56c5594674-zz58v\" (UID: \"9387f2c5-b3ac-40a4-96f0-832d23cbc39c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.597306 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.597286 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhz8t\" (UniqueName: \"kubernetes.io/projected/471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd-kube-api-access-mhz8t\") pod \"openshift-state-metrics-79f6958cdf-wrqlt\" (UID: \"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.685414 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.685385 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" Jul 18 00:58:00.714299 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.714274 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" Jul 18 00:58:00.750017 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.749855 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8r2t" Jul 18 00:58:00.821928 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.821901 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt"] Jul 18 00:58:00.824992 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:00.824968 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471ef1bb_c97f_4f39_a28f_0fe8edc6d0dd.slice/crio-3c69eea05e8121c6669105fccb8389e33880ad2c52a7e0e0974d30c94f2d94b5 WatchSource:0}: Error finding container 3c69eea05e8121c6669105fccb8389e33880ad2c52a7e0e0974d30c94f2d94b5: Status 404 returned error can't find the container with id 3c69eea05e8121c6669105fccb8389e33880ad2c52a7e0e0974d30c94f2d94b5 Jul 18 00:58:00.841978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.841956 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-zz58v"] Jul 18 00:58:00.844615 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:00.844592 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9387f2c5_b3ac_40a4_96f0_832d23cbc39c.slice/crio-7ba349bdcfbe1a9dee421e05ac26de3fef014fd044b1559b04d27a3a1ec71ad0 WatchSource:0}: Error finding container 7ba349bdcfbe1a9dee421e05ac26de3fef014fd044b1559b04d27a3a1ec71ad0: Status 404 returned error can't find the container with id 7ba349bdcfbe1a9dee421e05ac26de3fef014fd044b1559b04d27a3a1ec71ad0 Jul 18 00:58:00.865857 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.865826 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g5j2n" event={"ID":"cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa","Type":"ContainerStarted","Data":"056a85cb38d68527b82211b8b4008a76177f531e9dc7d2deff8cc3a3bef6ca1b"} Jul 18 00:58:00.867165 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.867143 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" event={"ID":"9387f2c5-b3ac-40a4-96f0-832d23cbc39c","Type":"ContainerStarted","Data":"7ba349bdcfbe1a9dee421e05ac26de3fef014fd044b1559b04d27a3a1ec71ad0"} Jul 18 00:58:00.868118 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.868084 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" event={"ID":"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd","Type":"ContainerStarted","Data":"3c69eea05e8121c6669105fccb8389e33880ad2c52a7e0e0974d30c94f2d94b5"} Jul 18 00:58:00.883334 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:00.883287 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g5j2n" podStartSLOduration=1.544293903 podStartE2EDuration="14.883269858s" totalImagesPullingTime="13.338975955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:57:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:00.883055569 +0000 UTC m=+62.939393101" watchObservedRunningTime="2026-07-18 00:58:00.883269858 +0000 UTC m=+62.939607391" Jul 18 00:58:01.091079 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.090995 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-tls\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:01.093220 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.093203 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aac263c9-741b-4718-8baa-0eaacb6bed7b-node-exporter-tls\") pod \"node-exporter-lt26n\" (UID: \"aac263c9-741b-4718-8baa-0eaacb6bed7b\") " pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:01.309050 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.309013 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lt26n" Jul 18 00:58:01.317781 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:01.317758 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac263c9_741b_4718_8baa_0eaacb6bed7b.slice/crio-22d243c04c8ddf1b61f586c8297470bdb30aa22d76da62365dd3f0ced41b44ee WatchSource:0}: Error finding container 22d243c04c8ddf1b61f586c8297470bdb30aa22d76da62365dd3f0ced41b44ee: Status 404 returned error can't find the container with id 22d243c04c8ddf1b61f586c8297470bdb30aa22d76da62365dd3f0ced41b44ee Jul 18 00:58:01.498006 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.497975 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:58:01.500881 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.500859 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.503751 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.503728 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 18 00:58:01.504041 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.504017 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 18 00:58:01.504382 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.504367 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 18 00:58:01.504570 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.504554 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c7wkj\"" Jul 18 00:58:01.504704 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.504630 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 18 00:58:01.504704 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.504558 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 18 00:58:01.504994 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.504978 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 18 00:58:01.505168 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.505132 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 18 00:58:01.507893 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.507871 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 18 00:58:01.508377 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.508356 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 18 00:58:01.518603 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.518523 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.595872 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.595924 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-out\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.595952 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfnrz\" (UniqueName: \"kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-kube-api-access-wfnrz\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.595998 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.596020 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.596040 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.596071 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.596137 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.596168 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.596195 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.596220 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.596309 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-web-config\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.596410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.596342 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.697494 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.696791 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-web-config\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.697494 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.696840 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.697494 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.696888 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.697494 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.696910 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-out\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.697494 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.696925 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfnrz\" (UniqueName: \"kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-kube-api-access-wfnrz\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.697494 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.696954 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.697494 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.696978 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.697494 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.697003 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.699806 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.697039 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.699806 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.698869 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.699806 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.698908 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.699806 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.698939 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.699806 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.698983 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.700888 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.700578 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.701990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.701713 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.701990 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.701959 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.702568 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.702527 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.702868 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.702846 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.703347 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.703306 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-out\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.703436 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.703378 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-web-config\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.703490 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.703433 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.703755 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.703535 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.704210 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.704179 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.704419 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.704400 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.705384 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.705358 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.709052 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.709011 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfnrz\" (UniqueName: \"kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-kube-api-access-wfnrz\") pod \"alertmanager-main-0\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.813643 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.813557 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:58:01.879748 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.879718 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" event={"ID":"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd","Type":"ContainerStarted","Data":"1f392f43194f5aae72a3a23a05dede6a75792e69338b2f5f24d286855d132a41"} Jul 18 00:58:01.879876 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.879815 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" event={"ID":"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd","Type":"ContainerStarted","Data":"fe9cfa23b0dd5f0fdeed376fb56d0a573adc9d3bcfb4507bd866d3347d9b133e"} Jul 18 00:58:01.881318 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.880970 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lt26n" event={"ID":"aac263c9-741b-4718-8baa-0eaacb6bed7b","Type":"ContainerStarted","Data":"22d243c04c8ddf1b61f586c8297470bdb30aa22d76da62365dd3f0ced41b44ee"} Jul 18 00:58:01.989513 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:01.989424 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:58:02.262238 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:02.262202 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2b79ec_94d1_4b54_beeb_a55ed9e897dd.slice/crio-48d2b51e25e5dc9134dc9e2ede5ece347b7126d9072a31b668b21e6f8faab196 WatchSource:0}: Error finding container 48d2b51e25e5dc9134dc9e2ede5ece347b7126d9072a31b668b21e6f8faab196: Status 404 returned error can't find the container with id 48d2b51e25e5dc9134dc9e2ede5ece347b7126d9072a31b668b21e6f8faab196 Jul 18 00:58:02.887042 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:02.886952 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" event={"ID":"9387f2c5-b3ac-40a4-96f0-832d23cbc39c","Type":"ContainerStarted","Data":"3851401858a3b4fd67b80b6b0b4ee8175df328a07380e6e9e0c789d3fa7814e7"} Jul 18 00:58:02.887042 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:02.887025 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" event={"ID":"9387f2c5-b3ac-40a4-96f0-832d23cbc39c","Type":"ContainerStarted","Data":"ab615e253f0d64de1c149980b64a416773b90b49af8d7ca3b3c84428e03e8f1f"} Jul 18 00:58:02.887524 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:02.887054 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" event={"ID":"9387f2c5-b3ac-40a4-96f0-832d23cbc39c","Type":"ContainerStarted","Data":"19e2debcf65f66ff57ba7a5e1ca92aa1c4be56e23cd9f802ef94c292fbf3fbe5"} Jul 18 00:58:02.889879 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:02.889848 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" event={"ID":"471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd","Type":"ContainerStarted","Data":"6620276e948da061c95ccd945dc441e255b121a436b0cb481d7998cbf77e08f3"} Jul 18 00:58:02.892050 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:02.892023 2548 generic.go:356] "Generic (PLEG): container finished" podID="aac263c9-741b-4718-8baa-0eaacb6bed7b" containerID="94c01a27858532eb857eb5a2622a65530c064cb4dd8e20d0091d4df5c944f04e" exitCode=0 Jul 18 00:58:02.892193 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:02.892135 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lt26n" event={"ID":"aac263c9-741b-4718-8baa-0eaacb6bed7b","Type":"ContainerDied","Data":"94c01a27858532eb857eb5a2622a65530c064cb4dd8e20d0091d4df5c944f04e"} Jul 18 00:58:02.893750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:02.893676 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerStarted","Data":"48d2b51e25e5dc9134dc9e2ede5ece347b7126d9072a31b668b21e6f8faab196"} Jul 18 00:58:02.907527 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:02.907465 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-zz58v" podStartSLOduration=1.253853363 podStartE2EDuration="2.907445922s" totalImagesPullingTime="1.653592559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:02.907341707 +0000 UTC m=+64.963679241" watchObservedRunningTime="2026-07-18 00:58:02.907445922 +0000 UTC m=+64.963783454" Jul 18 00:58:02.951917 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:02.951873 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wrqlt" podStartSLOduration=2.027793496 podStartE2EDuration="2.951854132s" totalImagesPullingTime="924.060636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:02.930198983 +0000 UTC m=+64.986536515" watchObservedRunningTime="2026-07-18 00:58:02.951854132 +0000 UTC m=+65.008191657" Jul 18 00:58:03.293011 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.292977 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-hcmms"] Jul 18 00:58:03.297684 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.297659 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-hcmms" Jul 18 00:58:03.300428 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.300404 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 18 00:58:03.300547 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.300454 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2xqln\"" Jul 18 00:58:03.300547 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.300534 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 18 00:58:03.305303 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.305281 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-hcmms"] Jul 18 00:58:03.414639 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.414602 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-256jw\" (UniqueName: \"kubernetes.io/projected/63c31aba-3452-4939-bdbf-3342b21d06b6-kube-api-access-256jw\") pod \"downloads-5bc67dcd46-hcmms\" (UID: \"63c31aba-3452-4939-bdbf-3342b21d06b6\") " pod="openshift-console/downloads-5bc67dcd46-hcmms" Jul 18 00:58:03.492978 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.492910 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-846698548f-6vzqk"] Jul 18 00:58:03.496219 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.496203 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.499390 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.499367 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 18 00:58:03.499499 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.499419 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 18 00:58:03.499854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.499839 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gkwh8\"" Jul 18 00:58:03.499895 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.499864 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 18 00:58:03.500569 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.500553 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 18 00:58:03.500788 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.500771 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 18 00:58:03.500888 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.500871 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d8l7svjj2mq31\"" Jul 18 00:58:03.515950 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.515925 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-256jw\" (UniqueName: \"kubernetes.io/projected/63c31aba-3452-4939-bdbf-3342b21d06b6-kube-api-access-256jw\") pod \"downloads-5bc67dcd46-hcmms\" (UID: \"63c31aba-3452-4939-bdbf-3342b21d06b6\") " pod="openshift-console/downloads-5bc67dcd46-hcmms" Jul 18 00:58:03.525397 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.525374 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-846698548f-6vzqk"] Jul 18 00:58:03.532444 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.532425 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-256jw\" (UniqueName: \"kubernetes.io/projected/63c31aba-3452-4939-bdbf-3342b21d06b6-kube-api-access-256jw\") pod \"downloads-5bc67dcd46-hcmms\" (UID: \"63c31aba-3452-4939-bdbf-3342b21d06b6\") " pod="openshift-console/downloads-5bc67dcd46-hcmms" Jul 18 00:58:03.616982 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.616947 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-grpc-tls\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.617171 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.617001 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62af278d-007d-40d4-9d2c-20f79269a9f9-metrics-client-ca\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.617171 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.617051 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.617171 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.617083 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxfpx\" (UniqueName: \"kubernetes.io/projected/62af278d-007d-40d4-9d2c-20f79269a9f9-kube-api-access-vxfpx\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.617280 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.617170 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.617280 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.617199 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.617280 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.617231 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-tls\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.617280 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.617266 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.624909 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.624891 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-hcmms" Jul 18 00:58:03.718609 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.718575 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-grpc-tls\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.718754 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.718643 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62af278d-007d-40d4-9d2c-20f79269a9f9-metrics-client-ca\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.718754 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.718671 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.718754 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.718691 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxfpx\" (UniqueName: \"kubernetes.io/projected/62af278d-007d-40d4-9d2c-20f79269a9f9-kube-api-access-vxfpx\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.718754 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.718715 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.718754 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.718743 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.718991 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.718767 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-tls\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.718991 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.718800 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.719657 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.719632 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62af278d-007d-40d4-9d2c-20f79269a9f9-metrics-client-ca\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.721892 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.721846 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.722363 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.722022 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-tls\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.723051 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.722488 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.723051 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.722724 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-grpc-tls\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.723051 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.722874 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.723420 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.723366 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62af278d-007d-40d4-9d2c-20f79269a9f9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.727612 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.727592 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxfpx\" (UniqueName: \"kubernetes.io/projected/62af278d-007d-40d4-9d2c-20f79269a9f9-kube-api-access-vxfpx\") pod \"thanos-querier-846698548f-6vzqk\" (UID: \"62af278d-007d-40d4-9d2c-20f79269a9f9\") " pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.753529 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.753507 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-hcmms"] Jul 18 00:58:03.754658 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:03.754639 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c31aba_3452_4939_bdbf_3342b21d06b6.slice/crio-f82f2d003984f49034cb00d9b159ac98da0bdf384a7248c181127972043f16cc WatchSource:0}: Error finding container f82f2d003984f49034cb00d9b159ac98da0bdf384a7248c181127972043f16cc: Status 404 returned error can't find the container with id f82f2d003984f49034cb00d9b159ac98da0bdf384a7248c181127972043f16cc Jul 18 00:58:03.809199 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.809174 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:03.837111 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.837067 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4z79s" Jul 18 00:58:03.903379 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.901169 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lt26n" event={"ID":"aac263c9-741b-4718-8baa-0eaacb6bed7b","Type":"ContainerStarted","Data":"6b2d8fd90eed807823c867fe961aac406d986b38bdf7e455112bfc9b9e1fdeb3"} Jul 18 00:58:03.903379 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.901229 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lt26n" event={"ID":"aac263c9-741b-4718-8baa-0eaacb6bed7b","Type":"ContainerStarted","Data":"18bf4ccf7f29489a9789737de03338321f3f078a446fa9e8054ecaba77e05614"} Jul 18 00:58:03.903379 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.902973 2548 generic.go:356] "Generic (PLEG): container finished" podID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerID="da5d71076511ee1133e6ff6d767972b20f41ede193ddd27efa2bc44bbecc6c42" exitCode=0 Jul 18 00:58:03.903379 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.903054 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerDied","Data":"da5d71076511ee1133e6ff6d767972b20f41ede193ddd27efa2bc44bbecc6c42"} Jul 18 00:58:03.905074 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.904971 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-hcmms" event={"ID":"63c31aba-3452-4939-bdbf-3342b21d06b6","Type":"ContainerStarted","Data":"f82f2d003984f49034cb00d9b159ac98da0bdf384a7248c181127972043f16cc"} Jul 18 00:58:03.921042 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.920997 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lt26n" podStartSLOduration=2.6385134089999998 podStartE2EDuration="3.920981524s" totalImagesPullingTime="1.182540154s" totalInitContainerRuntime="99.927961ms" isStatefulPod=true podCreationTimestamp="2026-07-18 00:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:03.920507549 +0000 UTC m=+65.976845080" watchObservedRunningTime="2026-07-18 00:58:03.920981524 +0000 UTC m=+65.977319055" Jul 18 00:58:03.950580 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:03.950549 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-846698548f-6vzqk"] Jul 18 00:58:03.954008 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:03.953970 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62af278d_007d_40d4_9d2c_20f79269a9f9.slice/crio-9ceb4a010d340d309442099516b5a0b3771662f8b585d8c676bb2670a67209c9 WatchSource:0}: Error finding container 9ceb4a010d340d309442099516b5a0b3771662f8b585d8c676bb2670a67209c9: Status 404 returned error can't find the container with id 9ceb4a010d340d309442099516b5a0b3771662f8b585d8c676bb2670a67209c9 Jul 18 00:58:04.122758 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.122667 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:58:04.125871 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.125849 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 00:58:04.135496 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.135474 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a03b934-a48a-4a2d-a72c-11faf54565e1-metrics-certs\") pod \"network-metrics-daemon-tsk8r\" (UID: \"2a03b934-a48a-4a2d-a72c-11faf54565e1\") " pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:58:04.199991 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.199958 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fzzvq\"" Jul 18 00:58:04.207599 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.207577 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsk8r" Jul 18 00:58:04.223889 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.223867 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:58:04.227000 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.226978 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 00:58:04.237211 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.237190 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db80b378-dd0f-4823-83b6-f7b2596fa989-original-pull-secret\") pod \"global-pull-secret-syncer-cggnq\" (UID: \"db80b378-dd0f-4823-83b6-f7b2596fa989\") " pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:58:04.324660 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.324615 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54lts\" (UniqueName: \"kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts\") pod \"network-check-target-rfltr\" (UID: \"bc894046-889c-47dd-989e-d8d4cf0d3114\") " pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:58:04.327910 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.327718 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 00:58:04.342544 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.342301 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 00:58:04.353028 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.352967 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54lts\" (UniqueName: \"kubernetes.io/projected/bc894046-889c-47dd-989e-d8d4cf0d3114-kube-api-access-54lts\") pod \"network-check-target-rfltr\" (UID: \"bc894046-889c-47dd-989e-d8d4cf0d3114\") " pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:58:04.371267 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.371197 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tsk8r"] Jul 18 00:58:04.374089 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:04.374028 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a03b934_a48a_4a2d_a72c_11faf54565e1.slice/crio-cd221cbeaaf338abf9858cc7977b1786c5238048d6e5ca99f7a9b295552e69bd WatchSource:0}: Error finding container cd221cbeaaf338abf9858cc7977b1786c5238048d6e5ca99f7a9b295552e69bd: Status 404 returned error can't find the container with id cd221cbeaaf338abf9858cc7977b1786c5238048d6e5ca99f7a9b295552e69bd Jul 18 00:58:04.494145 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.494115 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vk5c6\"" Jul 18 00:58:04.501559 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.501535 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:58:04.501693 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.501620 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cggnq" Jul 18 00:58:04.694983 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.694913 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cggnq"] Jul 18 00:58:04.698519 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:04.698487 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb80b378_dd0f_4823_83b6_f7b2596fa989.slice/crio-87f94c9c1f2a38735ff780ef0828997d5f51be78e6934fe669a9bba54cf57b30 WatchSource:0}: Error finding container 87f94c9c1f2a38735ff780ef0828997d5f51be78e6934fe669a9bba54cf57b30: Status 404 returned error can't find the container with id 87f94c9c1f2a38735ff780ef0828997d5f51be78e6934fe669a9bba54cf57b30 Jul 18 00:58:04.709465 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.709438 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68f989576b-bk4f7"] Jul 18 00:58:04.717268 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:04.717230 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc894046_889c_47dd_989e_d8d4cf0d3114.slice/crio-cbaed3f4959e48e63716091a07dca9b354e2e0e734a52194f9e1fc55472197c1 WatchSource:0}: Error finding container cbaed3f4959e48e63716091a07dca9b354e2e0e734a52194f9e1fc55472197c1: Status 404 returned error can't find the container with id cbaed3f4959e48e63716091a07dca9b354e2e0e734a52194f9e1fc55472197c1 Jul 18 00:58:04.718005 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.717930 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rfltr"] Jul 18 00:58:04.718107 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.718067 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.720134 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.720084 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68f989576b-bk4f7"] Jul 18 00:58:04.721530 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.721221 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 18 00:58:04.721530 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.721234 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fqr630lvbhpqu\"" Jul 18 00:58:04.721530 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.721285 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 18 00:58:04.721530 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.721412 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lbztv\"" Jul 18 00:58:04.721530 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.721456 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 18 00:58:04.722272 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.722034 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 18 00:58:04.831365 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.830961 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55954dc2-9545-4661-9da1-16831d88873b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.831365 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.831027 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqllv\" (UniqueName: \"kubernetes.io/projected/55954dc2-9545-4661-9da1-16831d88873b-kube-api-access-vqllv\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.831365 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.831072 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/55954dc2-9545-4661-9da1-16831d88873b-audit-log\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.831365 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.831126 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/55954dc2-9545-4661-9da1-16831d88873b-metrics-server-audit-profiles\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.831365 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.831160 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/55954dc2-9545-4661-9da1-16831d88873b-secret-metrics-server-tls\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.831365 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.831205 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/55954dc2-9545-4661-9da1-16831d88873b-secret-metrics-server-client-certs\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.831365 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.831229 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55954dc2-9545-4661-9da1-16831d88873b-client-ca-bundle\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.912565 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.912372 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tsk8r" event={"ID":"2a03b934-a48a-4a2d-a72c-11faf54565e1","Type":"ContainerStarted","Data":"cd221cbeaaf338abf9858cc7977b1786c5238048d6e5ca99f7a9b295552e69bd"} Jul 18 00:58:04.915532 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.915443 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cggnq" event={"ID":"db80b378-dd0f-4823-83b6-f7b2596fa989","Type":"ContainerStarted","Data":"87f94c9c1f2a38735ff780ef0828997d5f51be78e6934fe669a9bba54cf57b30"} Jul 18 00:58:04.917391 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.917321 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rfltr" event={"ID":"bc894046-889c-47dd-989e-d8d4cf0d3114","Type":"ContainerStarted","Data":"cbaed3f4959e48e63716091a07dca9b354e2e0e734a52194f9e1fc55472197c1"} Jul 18 00:58:04.919797 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.919687 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" event={"ID":"62af278d-007d-40d4-9d2c-20f79269a9f9","Type":"ContainerStarted","Data":"9ceb4a010d340d309442099516b5a0b3771662f8b585d8c676bb2670a67209c9"} Jul 18 00:58:04.934733 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.932484 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55954dc2-9545-4661-9da1-16831d88873b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.934733 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.932540 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqllv\" (UniqueName: \"kubernetes.io/projected/55954dc2-9545-4661-9da1-16831d88873b-kube-api-access-vqllv\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.934733 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.932579 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/55954dc2-9545-4661-9da1-16831d88873b-audit-log\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.934733 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.932609 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/55954dc2-9545-4661-9da1-16831d88873b-metrics-server-audit-profiles\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.934733 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.932639 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/55954dc2-9545-4661-9da1-16831d88873b-secret-metrics-server-tls\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.934733 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.932684 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/55954dc2-9545-4661-9da1-16831d88873b-secret-metrics-server-client-certs\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.934733 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.932710 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55954dc2-9545-4661-9da1-16831d88873b-client-ca-bundle\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.934733 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.933495 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/55954dc2-9545-4661-9da1-16831d88873b-audit-log\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.934733 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.934162 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55954dc2-9545-4661-9da1-16831d88873b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.936435 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.936144 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55954dc2-9545-4661-9da1-16831d88873b-client-ca-bundle\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.936435 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.936242 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/55954dc2-9545-4661-9da1-16831d88873b-metrics-server-audit-profiles\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.939395 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.939351 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/55954dc2-9545-4661-9da1-16831d88873b-secret-metrics-server-client-certs\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.940188 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.940019 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/55954dc2-9545-4661-9da1-16831d88873b-secret-metrics-server-tls\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:04.952717 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:04.952668 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqllv\" (UniqueName: \"kubernetes.io/projected/55954dc2-9545-4661-9da1-16831d88873b-kube-api-access-vqllv\") pod \"metrics-server-68f989576b-bk4f7\" (UID: \"55954dc2-9545-4661-9da1-16831d88873b\") " pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:05.034949 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.034081 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:05.191770 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.191688 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs"] Jul 18 00:58:05.196215 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.196189 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" Jul 18 00:58:05.202535 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.201739 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 18 00:58:05.202535 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.201808 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-68cgv\"" Jul 18 00:58:05.207970 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.207854 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs"] Jul 18 00:58:05.223140 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.222500 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68f989576b-bk4f7"] Jul 18 00:58:05.337695 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.337665 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c3cd76c-2ce6-495d-991a-17c400364d38-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-gdvgs\" (UID: \"0c3cd76c-2ce6-495d-991a-17c400364d38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" Jul 18 00:58:05.337866 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.337725 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxp65\" (UniqueName: \"kubernetes.io/projected/0c3cd76c-2ce6-495d-991a-17c400364d38-kube-api-access-fxp65\") pod \"monitoring-plugin-7b7b7bc8bf-gdvgs\" (UID: \"0c3cd76c-2ce6-495d-991a-17c400364d38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" Jul 18 00:58:05.438987 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.438555 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c3cd76c-2ce6-495d-991a-17c400364d38-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-gdvgs\" (UID: \"0c3cd76c-2ce6-495d-991a-17c400364d38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" Jul 18 00:58:05.438987 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.438629 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxp65\" (UniqueName: \"kubernetes.io/projected/0c3cd76c-2ce6-495d-991a-17c400364d38-kube-api-access-fxp65\") pod \"monitoring-plugin-7b7b7bc8bf-gdvgs\" (UID: \"0c3cd76c-2ce6-495d-991a-17c400364d38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" Jul 18 00:58:05.445767 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.445706 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c3cd76c-2ce6-495d-991a-17c400364d38-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-gdvgs\" (UID: \"0c3cd76c-2ce6-495d-991a-17c400364d38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" Jul 18 00:58:05.448838 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.448792 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxp65\" (UniqueName: \"kubernetes.io/projected/0c3cd76c-2ce6-495d-991a-17c400364d38-kube-api-access-fxp65\") pod \"monitoring-plugin-7b7b7bc8bf-gdvgs\" (UID: \"0c3cd76c-2ce6-495d-991a-17c400364d38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" Jul 18 00:58:05.520415 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:05.520183 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" Jul 18 00:58:06.763559 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.763513 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 00:58:06.782216 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.780958 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.782216 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.781423 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 00:58:06.784420 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.784294 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 18 00:58:06.784577 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.784544 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 18 00:58:06.787321 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.785202 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c1604rvs1n2a5\"" Jul 18 00:58:06.787321 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.785398 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 18 00:58:06.787321 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.785595 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 18 00:58:06.787321 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.785767 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9w52d\"" Jul 18 00:58:06.787321 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.786345 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 18 00:58:06.787321 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.786873 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 18 00:58:06.787321 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.787072 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 18 00:58:06.790054 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.788236 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 18 00:58:06.790054 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.789404 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 18 00:58:06.790054 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.789587 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 18 00:58:06.790054 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.789697 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 18 00:58:06.790054 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.789867 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 18 00:58:06.796896 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.796749 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 18 00:58:06.797189 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.797019 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 18 00:58:06.856857 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.856814 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857038 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.856867 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857038 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.856904 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857038 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.856926 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857038 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.856955 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857038 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.856988 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857038 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857020 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857357 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857056 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857357 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857078 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857357 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857127 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857357 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857165 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857357 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857212 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857357 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857236 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857357 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857270 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857357 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857293 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-config\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857357 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857328 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-web-config\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857357 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857351 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qkcz\" (UniqueName: \"kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-kube-api-access-8qkcz\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857814 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857378 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857814 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857415 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-config-out\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.857814 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.857538 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.958679 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.958641 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.958844 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.958689 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.958844 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.958730 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.958844 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.958757 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-config\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.958844 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.958792 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-web-config\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.958844 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.958819 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qkcz\" (UniqueName: \"kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-kube-api-access-8qkcz\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959122 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.958848 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959122 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.958876 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-config-out\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959122 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.958909 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959122 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.958950 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959122 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.958974 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959122 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.959009 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959122 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.959033 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959122 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.959060 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959122 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.959112 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959559 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.959145 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959559 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.959188 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959559 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.959210 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959559 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.959234 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.959559 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.959273 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.961081 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.961051 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.961081 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.961062 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.962109 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.962062 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.963594 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.962737 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.963594 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.963288 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.968681 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.966553 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.968681 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.966952 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-config\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.968681 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.967066 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.968681 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.967493 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.968681 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.967905 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.968681 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.967947 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.968681 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.968359 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.968681 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.968390 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-web-config\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.970118 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.969229 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-config-out\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.972235 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.972207 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.972340 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.972218 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.972626 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.972603 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.973161 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.973139 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.973973 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.973953 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qkcz\" (UniqueName: \"kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-kube-api-access-8qkcz\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:06.974561 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:06.974540 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:07.019128 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:07.019034 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55954dc2_9545_4661_9da1_16831d88873b.slice/crio-8227b1cc079d513f070252162dd47232820fd454e74a1e107f73b7ad29196ec7 WatchSource:0}: Error finding container 8227b1cc079d513f070252162dd47232820fd454e74a1e107f73b7ad29196ec7: Status 404 returned error can't find the container with id 8227b1cc079d513f070252162dd47232820fd454e74a1e107f73b7ad29196ec7 Jul 18 00:58:07.101464 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.101174 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:07.687535 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.687285 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs"] Jul 18 00:58:07.691652 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:07.691617 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3cd76c_2ce6_495d_991a_17c400364d38.slice/crio-2f894968279b9b0110a7ec2f28262de8660780e99add4271fb049b16f22364d3 WatchSource:0}: Error finding container 2f894968279b9b0110a7ec2f28262de8660780e99add4271fb049b16f22364d3: Status 404 returned error can't find the container with id 2f894968279b9b0110a7ec2f28262de8660780e99add4271fb049b16f22364d3 Jul 18 00:58:07.732306 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.732214 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 00:58:07.754178 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:58:07.754146 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4841908b_1bbb_4c64_a43b_2d1588fdb156.slice/crio-04a0ab7dab929013786237511e6992c8105a2fdd4d6a17bfab8c281632d8d755 WatchSource:0}: Error finding container 04a0ab7dab929013786237511e6992c8105a2fdd4d6a17bfab8c281632d8d755: Status 404 returned error can't find the container with id 04a0ab7dab929013786237511e6992c8105a2fdd4d6a17bfab8c281632d8d755 Jul 18 00:58:07.946537 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.946327 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" event={"ID":"62af278d-007d-40d4-9d2c-20f79269a9f9","Type":"ContainerStarted","Data":"327eb0070ad3c1fa38bc0453283f4048844a01abe8af1ebf176f0ef5cbb6ab14"} Jul 18 00:58:07.946537 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.946424 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" event={"ID":"62af278d-007d-40d4-9d2c-20f79269a9f9","Type":"ContainerStarted","Data":"79e601dc02480694a841251331f5ea851be988c8423905818be8d142a9c490d7"} Jul 18 00:58:07.946537 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.946469 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" event={"ID":"62af278d-007d-40d4-9d2c-20f79269a9f9","Type":"ContainerStarted","Data":"70ce9f34eb0919845a298fc491b4b78d93ed4a02f4f992c007444319dbbd5bc9"} Jul 18 00:58:07.948361 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.948338 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" event={"ID":"55954dc2-9545-4661-9da1-16831d88873b","Type":"ContainerStarted","Data":"8227b1cc079d513f070252162dd47232820fd454e74a1e107f73b7ad29196ec7"} Jul 18 00:58:07.952110 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.951329 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tsk8r" event={"ID":"2a03b934-a48a-4a2d-a72c-11faf54565e1","Type":"ContainerStarted","Data":"fbeb7bf1ae6d6da5adedf519c4712099980d1abc9ee66dbf71cbffb47b172855"} Jul 18 00:58:07.952110 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.951375 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tsk8r" event={"ID":"2a03b934-a48a-4a2d-a72c-11faf54565e1","Type":"ContainerStarted","Data":"06c329a6baec512415d512b37b5a0b10ad5c94586ba0c9d7de1f730e739e1a0a"} Jul 18 00:58:07.956843 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.956821 2548 generic.go:356] "Generic (PLEG): container finished" podID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerID="36105313a28f83f092e64182a7eb509ba7060bbaecbbde71e307acda1ea94f93" exitCode=0 Jul 18 00:58:07.957662 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.956999 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerDied","Data":"36105313a28f83f092e64182a7eb509ba7060bbaecbbde71e307acda1ea94f93"} Jul 18 00:58:07.957750 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.957734 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerStarted","Data":"04a0ab7dab929013786237511e6992c8105a2fdd4d6a17bfab8c281632d8d755"} Jul 18 00:58:07.960604 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.960555 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" event={"ID":"0c3cd76c-2ce6-495d-991a-17c400364d38","Type":"ContainerStarted","Data":"2f894968279b9b0110a7ec2f28262de8660780e99add4271fb049b16f22364d3"} Jul 18 00:58:07.963112 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.963007 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerStarted","Data":"6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998"} Jul 18 00:58:07.963112 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.963057 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerStarted","Data":"300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b"} Jul 18 00:58:07.969270 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:07.969235 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tsk8r" podStartSLOduration=65.816971475 podStartE2EDuration="1m8.969221666s" totalImagesPullingTime="3.152250191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:07.968009464 +0000 UTC m=+70.024346996" watchObservedRunningTime="2026-07-18 00:58:07.969221666 +0000 UTC m=+70.025559196" Jul 18 00:58:08.973043 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:08.973002 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerStarted","Data":"70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514"} Jul 18 00:58:08.973454 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:08.973080 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerStarted","Data":"c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d"} Jul 18 00:58:11.994183 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:11.994138 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerStarted","Data":"ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5"} Jul 18 00:58:13.004997 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.004956 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerStarted","Data":"d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee"} Jul 18 00:58:13.007397 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.007368 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cggnq" event={"ID":"db80b378-dd0f-4823-83b6-f7b2596fa989","Type":"ContainerStarted","Data":"03773986c34b4fc569d3249e6d0cde0cc02fc9155db6ad5bd8c9c42a859715cc"} Jul 18 00:58:13.009898 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.009869 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rfltr" event={"ID":"bc894046-889c-47dd-989e-d8d4cf0d3114","Type":"ContainerStarted","Data":"164ac3249e1a343e81788f52319b1833dd343dfcb2b7ebf18e0450ccab7210a6"} Jul 18 00:58:13.010022 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.010009 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:58:13.014903 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.014876 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" event={"ID":"62af278d-007d-40d4-9d2c-20f79269a9f9","Type":"ContainerStarted","Data":"32651ee4b5f7b939d60c82287c587fc8cd742e4eb0db7145658adcca25ad2050"} Jul 18 00:58:13.015012 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.014946 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" event={"ID":"62af278d-007d-40d4-9d2c-20f79269a9f9","Type":"ContainerStarted","Data":"73928e9edb5198f3ec81f45f7805289626b817e91dc31bb26994d41db6d8dc60"} Jul 18 00:58:13.015012 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.014992 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" event={"ID":"62af278d-007d-40d4-9d2c-20f79269a9f9","Type":"ContainerStarted","Data":"d921366012aa6983e9a0c49b91b918d759f92278abeb09066ff2e55e8ff7a1b6"} Jul 18 00:58:13.015769 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.015355 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:13.016456 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.016429 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" event={"ID":"55954dc2-9545-4661-9da1-16831d88873b","Type":"ContainerStarted","Data":"08774074a37fe57126d66bf3ef78961907b7d91a7b575420fe43c452cee3735d"} Jul 18 00:58:13.018314 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.018294 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" event={"ID":"0c3cd76c-2ce6-495d-991a-17c400364d38","Type":"ContainerStarted","Data":"77e3cab437321acf15e26db0c07068546e1e401d907c14654652142e72cb87fd"} Jul 18 00:58:13.018656 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.018640 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" Jul 18 00:58:13.021841 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.021781 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" Jul 18 00:58:13.024141 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.024122 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" Jul 18 00:58:13.033227 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.032407 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.709372533 podStartE2EDuration="12.032389377s" totalImagesPullingTime="5.306052232s" totalInitContainerRuntime="16.964612ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:58:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:13.030651721 +0000 UTC m=+75.086989252" watchObservedRunningTime="2026-07-18 00:58:13.032389377 +0000 UTC m=+75.088726910" Jul 18 00:58:13.048130 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.048040 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gdvgs" podStartSLOduration=3.304558916 podStartE2EDuration="8.048021362s" totalImagesPullingTime="4.743462446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:13.046900132 +0000 UTC m=+75.103237664" watchObservedRunningTime="2026-07-18 00:58:13.048021362 +0000 UTC m=+75.104358897" Jul 18 00:58:13.069352 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.068700 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-846698548f-6vzqk" podStartSLOduration=1.955817463 podStartE2EDuration="10.068682417s" totalImagesPullingTime="8.112864954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:58:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:13.067622042 +0000 UTC m=+75.123959573" watchObservedRunningTime="2026-07-18 00:58:13.068682417 +0000 UTC m=+75.125019946" Jul 18 00:58:13.083166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.083117 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rfltr" podStartSLOduration=67.045491408 podStartE2EDuration="1m14.083104539s" totalImagesPullingTime="7.037613131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:13.082125047 +0000 UTC m=+75.138462578" watchObservedRunningTime="2026-07-18 00:58:13.083104539 +0000 UTC m=+75.139442062" Jul 18 00:58:13.101481 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.101417 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" podStartSLOduration=4.389106277 podStartE2EDuration="9.101399377s" totalImagesPullingTime="4.7122931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:13.099714031 +0000 UTC m=+75.156051563" watchObservedRunningTime="2026-07-18 00:58:13.101399377 +0000 UTC m=+75.157736912" Jul 18 00:58:13.118880 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:13.117181 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cggnq" podStartSLOduration=66.406647022 podStartE2EDuration="1m14.117162869s" totalImagesPullingTime="7.710515847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:13.116828517 +0000 UTC m=+75.173166049" watchObservedRunningTime="2026-07-18 00:58:13.117162869 +0000 UTC m=+75.173500404" Jul 18 00:58:16.039826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:16.039791 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerStarted","Data":"a8abe579911e497bc12aabf50e240b941f655ab1788c7c3ccdb0ac55ddf39daf"} Jul 18 00:58:16.040272 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:16.039873 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerStarted","Data":"0f518c9d198a18a2cdfc0bb4e2d249c1374bec651dae2f49bb17d053c4aaca96"} Jul 18 00:58:16.040272 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:16.039923 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerStarted","Data":"39c3f7bb621eccfdb99f154493ff92e3ca2d5d6f74e393f0732a786df31c0fbf"} Jul 18 00:58:16.040272 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:16.039968 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerStarted","Data":"018fdc07a3b392fc7e7775f4326bc810d2eb89816af689a1f8c860b7f0b4f952"} Jul 18 00:58:16.040272 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:16.040014 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerStarted","Data":"6fe6021454c98d8c793799edcff48b106b9acc960761bdb7f7f57965f9036a11"} Jul 18 00:58:16.040272 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:16.040052 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerStarted","Data":"7e231a1ee7ec41be3fa0b578812f949258a6e505d01ebbe19266cf96d2e12e78"} Jul 18 00:58:16.069935 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:16.069204 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.731942434 podStartE2EDuration="10.06918396s" totalImagesPullingTime="7.301088486s" totalInitContainerRuntime="36.15304ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:16.06636898 +0000 UTC m=+78.122706519" watchObservedRunningTime="2026-07-18 00:58:16.06918396 +0000 UTC m=+78.125521492" Jul 18 00:58:17.101571 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:17.101541 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:58:24.079866 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:24.079773 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-hcmms" event={"ID":"63c31aba-3452-4939-bdbf-3342b21d06b6","Type":"ContainerStarted","Data":"e3d4b912da5897ecfdb81495ef4386eb677c05fce519d62cf4e6570a52fda392"} Jul 18 00:58:24.080299 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:24.079960 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-hcmms" Jul 18 00:58:24.081418 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:24.081389 2548 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-hcmms container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" start-of-body= Jul 18 00:58:24.081530 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:24.081445 2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-hcmms" podUID="63c31aba-3452-4939-bdbf-3342b21d06b6" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" Jul 18 00:58:24.099878 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:24.099823 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-hcmms" podStartSLOduration=1.048017957 podStartE2EDuration="21.099808086s" totalImagesPullingTime="20.051790129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:58:24.097531787 +0000 UTC m=+86.153869320" watchObservedRunningTime="2026-07-18 00:58:24.099808086 +0000 UTC m=+86.156145617" Jul 18 00:58:25.035445 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:25.035408 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:25.035632 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:25.035487 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:25.102236 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:25.102211 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-hcmms" Jul 18 00:58:44.028770 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:44.028740 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rfltr" Jul 18 00:58:45.040594 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:45.040565 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:58:45.044367 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:58:45.044345 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68f989576b-bk4f7" Jul 18 00:59:07.102513 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:07.102474 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:07.177531 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:07.177503 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:07.283921 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:07.283572 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:20.765698 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:20.765664 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:59:20.766176 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:20.765987 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="alertmanager" containerID="cri-o://300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b" gracePeriod=120 Jul 18 00:59:20.766176 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:20.766054 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy-metric" containerID="cri-o://ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5" gracePeriod=120 Jul 18 00:59:20.766176 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:20.766137 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="prom-label-proxy" containerID="cri-o://d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee" gracePeriod=120 Jul 18 00:59:20.766332 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:20.766146 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy-web" containerID="cri-o://c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d" gracePeriod=120 Jul 18 00:59:20.766332 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:20.766182 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy" containerID="cri-o://70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514" gracePeriod=120 Jul 18 00:59:20.766457 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:20.766398 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="config-reloader" containerID="cri-o://6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998" gracePeriod=120 Jul 18 00:59:21.321847 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:21.321816 2548 generic.go:356] "Generic (PLEG): container finished" podID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerID="d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee" exitCode=0 Jul 18 00:59:21.321847 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:21.321841 2548 generic.go:356] "Generic (PLEG): container finished" podID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerID="ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5" exitCode=0 Jul 18 00:59:21.321847 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:21.321847 2548 generic.go:356] "Generic (PLEG): container finished" podID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerID="70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514" exitCode=0 Jul 18 00:59:21.321847 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:21.321853 2548 generic.go:356] "Generic (PLEG): container finished" podID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerID="6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998" exitCode=0 Jul 18 00:59:21.322151 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:21.321858 2548 generic.go:356] "Generic (PLEG): container finished" podID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerID="300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b" exitCode=0 Jul 18 00:59:21.322151 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:21.321883 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerDied","Data":"d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee"} Jul 18 00:59:21.322151 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:21.321944 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerDied","Data":"ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5"} Jul 18 00:59:21.322151 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:21.321970 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerDied","Data":"70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514"} Jul 18 00:59:21.322151 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:21.321992 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerDied","Data":"6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998"} Jul 18 00:59:21.322151 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:21.322025 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerDied","Data":"300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b"} Jul 18 00:59:22.007696 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.007668 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.052448 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052416 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052625 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052466 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-cluster-tls-config\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052625 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052505 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-tls-assets\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052625 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052530 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052625 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052564 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-trusted-ca-bundle\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052625 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052596 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfnrz\" (UniqueName: \"kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-kube-api-access-wfnrz\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052625 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052622 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-main-db\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052976 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052718 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-volume\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052976 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052744 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-web-config\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052976 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052774 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-main-tls\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052976 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052833 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-out\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052976 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052856 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-metrics-client-ca\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.052976 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.052891 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy\") pod \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\" (UID: \"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd\") " Jul 18 00:59:22.054677 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.054395 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:59:22.056156 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.056088 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:59:22.057558 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.057535 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:59:22.057710 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.057538 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:22.058125 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.058077 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-kube-api-access-wfnrz" (OuterVolumeSpecName: "kube-api-access-wfnrz") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "kube-api-access-wfnrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:59:22.058512 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.058485 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:59:22.058612 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.058554 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:22.059749 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.059712 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:22.060028 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.059994 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-out" (OuterVolumeSpecName: "config-out") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:59:22.060273 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.060160 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-volume" (OuterVolumeSpecName: "config-volume") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:22.060434 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.060396 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:22.062336 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.062283 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:22.072724 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.072696 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-web-config" (OuterVolumeSpecName: "web-config") pod "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" (UID: "5f2b79ec-94d1-4b54-beeb-a55ed9e897dd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:22.154752 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154681 2548 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-out\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.154752 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154705 2548 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-metrics-client-ca\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.154752 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154716 2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.154752 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154725 2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.154752 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154734 2548 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-cluster-tls-config\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.154752 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154742 2548 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-tls-assets\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.154752 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154750 2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.154752 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154759 2548 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.155133 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154769 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfnrz\" (UniqueName: \"kubernetes.io/projected/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-kube-api-access-wfnrz\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.155133 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154776 2548 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-alertmanager-main-db\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.155133 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154784 2548 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-config-volume\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.155133 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154791 2548 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-web-config\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.155133 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.154798 2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd-secret-alertmanager-main-tls\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:22.329052 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.329023 2548 generic.go:356] "Generic (PLEG): container finished" podID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerID="c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d" exitCode=0 Jul 18 00:59:22.329250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.329110 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerDied","Data":"c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d"} Jul 18 00:59:22.329250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.329129 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.329250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.329192 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f2b79ec-94d1-4b54-beeb-a55ed9e897dd","Type":"ContainerDied","Data":"48d2b51e25e5dc9134dc9e2ede5ece347b7126d9072a31b668b21e6f8faab196"} Jul 18 00:59:22.329250 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.329224 2548 scope.go:117] "RemoveContainer" containerID="d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee" Jul 18 00:59:22.337135 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.337114 2548 scope.go:117] "RemoveContainer" containerID="ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5" Jul 18 00:59:22.344387 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.344367 2548 scope.go:117] "RemoveContainer" containerID="70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514" Jul 18 00:59:22.350994 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.350977 2548 scope.go:117] "RemoveContainer" containerID="c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d" Jul 18 00:59:22.356807 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.356786 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:59:22.358491 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.358477 2548 scope.go:117] "RemoveContainer" containerID="6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998" Jul 18 00:59:22.362979 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.362961 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:59:22.366087 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.366073 2548 scope.go:117] "RemoveContainer" containerID="300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b" Jul 18 00:59:22.372908 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.372893 2548 scope.go:117] "RemoveContainer" containerID="da5d71076511ee1133e6ff6d767972b20f41ede193ddd27efa2bc44bbecc6c42" Jul 18 00:59:22.379794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.379776 2548 scope.go:117] "RemoveContainer" containerID="d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee" Jul 18 00:59:22.380059 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:59:22.380038 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee\": container with ID starting with d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee not found: ID does not exist" containerID="d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee" Jul 18 00:59:22.380117 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.380070 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee"} err="failed to get container status \"d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee\": rpc error: code = NotFound desc = could not find container \"d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee\": container with ID starting with d7b401d826962390566d34d1943c6b337e11a493ea48f5fe4696804a62d698ee not found: ID does not exist" Jul 18 00:59:22.380162 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.380122 2548 scope.go:117] "RemoveContainer" containerID="ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5" Jul 18 00:59:22.380330 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:59:22.380316 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5\": container with ID starting with ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5 not found: ID does not exist" containerID="ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5" Jul 18 00:59:22.380374 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.380334 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5"} err="failed to get container status \"ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5\": rpc error: code = NotFound desc = could not find container \"ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5\": container with ID starting with ee1757d27a1a676a60e78e55354c0cf663427bfb4c157f2dfbeca685e1a1b4c5 not found: ID does not exist" Jul 18 00:59:22.380374 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.380350 2548 scope.go:117] "RemoveContainer" containerID="70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514" Jul 18 00:59:22.380567 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:59:22.380549 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514\": container with ID starting with 70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514 not found: ID does not exist" containerID="70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514" Jul 18 00:59:22.380604 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.380571 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514"} err="failed to get container status \"70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514\": rpc error: code = NotFound desc = could not find container \"70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514\": container with ID starting with 70703a2a81de104b74bc9162cc0203180cee15695d72c916097cbe73a99a4514 not found: ID does not exist" Jul 18 00:59:22.380604 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.380585 2548 scope.go:117] "RemoveContainer" containerID="c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d" Jul 18 00:59:22.380824 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:59:22.380806 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d\": container with ID starting with c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d not found: ID does not exist" containerID="c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d" Jul 18 00:59:22.380877 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.380829 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d"} err="failed to get container status \"c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d\": rpc error: code = NotFound desc = could not find container \"c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d\": container with ID starting with c30604a98a2b03721b020c52af75bac1b3414aa550bb44d7296846d84fd3ae1d not found: ID does not exist" Jul 18 00:59:22.380877 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.380845 2548 scope.go:117] "RemoveContainer" containerID="6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998" Jul 18 00:59:22.381110 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:59:22.381078 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998\": container with ID starting with 6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998 not found: ID does not exist" containerID="6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998" Jul 18 00:59:22.381159 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.381116 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998"} err="failed to get container status \"6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998\": rpc error: code = NotFound desc = could not find container \"6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998\": container with ID starting with 6b0c5a2cb25a13e07077d21cd79e8be4070e027a1bdbcd8c69c14a2629c9e998 not found: ID does not exist" Jul 18 00:59:22.381159 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.381134 2548 scope.go:117] "RemoveContainer" containerID="300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b" Jul 18 00:59:22.381394 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:59:22.381378 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b\": container with ID starting with 300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b not found: ID does not exist" containerID="300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b" Jul 18 00:59:22.381444 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.381397 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b"} err="failed to get container status \"300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b\": rpc error: code = NotFound desc = could not find container \"300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b\": container with ID starting with 300c6878e29d2596b720f6b16a303c79aa0d861054adda27b5c13d7208562a8b not found: ID does not exist" Jul 18 00:59:22.381444 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.381412 2548 scope.go:117] "RemoveContainer" containerID="da5d71076511ee1133e6ff6d767972b20f41ede193ddd27efa2bc44bbecc6c42" Jul 18 00:59:22.381626 ip-10-0-140-116 kubenswrapper[2548]: E0718 00:59:22.381611 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da5d71076511ee1133e6ff6d767972b20f41ede193ddd27efa2bc44bbecc6c42\": container with ID starting with da5d71076511ee1133e6ff6d767972b20f41ede193ddd27efa2bc44bbecc6c42 not found: ID does not exist" containerID="da5d71076511ee1133e6ff6d767972b20f41ede193ddd27efa2bc44bbecc6c42" Jul 18 00:59:22.381665 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.381629 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5d71076511ee1133e6ff6d767972b20f41ede193ddd27efa2bc44bbecc6c42"} err="failed to get container status \"da5d71076511ee1133e6ff6d767972b20f41ede193ddd27efa2bc44bbecc6c42\": rpc error: code = NotFound desc = could not find container \"da5d71076511ee1133e6ff6d767972b20f41ede193ddd27efa2bc44bbecc6c42\": container with ID starting with da5d71076511ee1133e6ff6d767972b20f41ede193ddd27efa2bc44bbecc6c42 not found: ID does not exist" Jul 18 00:59:22.386487 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386459 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:59:22.386754 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386742 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="prom-label-proxy" Jul 18 00:59:22.386794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386757 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="prom-label-proxy" Jul 18 00:59:22.386794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386773 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy-web" Jul 18 00:59:22.386794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386778 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy-web" Jul 18 00:59:22.386794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386786 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="init-config-reloader" Jul 18 00:59:22.386794 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386791 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="init-config-reloader" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386797 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386802 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386809 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="alertmanager" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386814 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="alertmanager" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386822 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="config-reloader" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386827 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="config-reloader" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386835 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy-metric" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386840 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy-metric" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386884 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy-metric" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386892 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy-web" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386898 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="alertmanager" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386918 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="config-reloader" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386924 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="kube-rbac-proxy" Jul 18 00:59:22.386933 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.386929 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" containerName="prom-label-proxy" Jul 18 00:59:22.391506 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.391489 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.394493 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.394453 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c7wkj\"" Jul 18 00:59:22.394588 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.394489 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 18 00:59:22.394588 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.394518 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 18 00:59:22.394588 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.394535 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 18 00:59:22.394588 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.394570 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 18 00:59:22.394798 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.394607 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 18 00:59:22.394885 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.394871 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 18 00:59:22.394946 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.394897 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 18 00:59:22.394946 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.394870 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 18 00:59:22.400668 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.400653 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 18 00:59:22.403881 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.403861 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:59:22.456789 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.456766 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.456927 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.456801 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a94994cb-7d73-45fd-8d50-acacba46d495-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.456927 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.456832 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfbkt\" (UniqueName: \"kubernetes.io/projected/a94994cb-7d73-45fd-8d50-acacba46d495-kube-api-access-vfbkt\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.456927 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.456851 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.456927 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.456917 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-config-volume\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.457166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.456960 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.457166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.456978 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-web-config\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.457166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.456997 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.457166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.457017 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94994cb-7d73-45fd-8d50-acacba46d495-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.457166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.457056 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94994cb-7d73-45fd-8d50-acacba46d495-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.457166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.457122 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a94994cb-7d73-45fd-8d50-acacba46d495-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.457166 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.457152 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a94994cb-7d73-45fd-8d50-acacba46d495-config-out\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.457399 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.457174 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.477565 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.477539 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f2b79ec-94d1-4b54-beeb-a55ed9e897dd" path="/var/lib/kubelet/pods/5f2b79ec-94d1-4b54-beeb-a55ed9e897dd/volumes" Jul 18 00:59:22.557734 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.557708 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfbkt\" (UniqueName: \"kubernetes.io/projected/a94994cb-7d73-45fd-8d50-acacba46d495-kube-api-access-vfbkt\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.557858 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.557740 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.557858 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.557766 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-config-volume\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.557858 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.557809 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.557858 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.557834 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-web-config\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.558028 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.557863 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.558028 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.557893 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94994cb-7d73-45fd-8d50-acacba46d495-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.558028 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.557919 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94994cb-7d73-45fd-8d50-acacba46d495-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.558028 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.557942 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a94994cb-7d73-45fd-8d50-acacba46d495-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.558028 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.557963 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a94994cb-7d73-45fd-8d50-acacba46d495-config-out\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.558028 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.557985 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.558028 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.558011 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.558382 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.558041 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a94994cb-7d73-45fd-8d50-acacba46d495-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.559223 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.559199 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94994cb-7d73-45fd-8d50-acacba46d495-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.560281 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.560257 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94994cb-7d73-45fd-8d50-acacba46d495-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.560983 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.560961 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.561063 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.560967 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-config-volume\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.561063 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.561018 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a94994cb-7d73-45fd-8d50-acacba46d495-config-out\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.561273 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.561252 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a94994cb-7d73-45fd-8d50-acacba46d495-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.561328 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.561310 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a94994cb-7d73-45fd-8d50-acacba46d495-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.561373 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.561333 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.561373 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.561361 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-web-config\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.561442 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.561419 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.562497 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.562480 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.563086 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.563069 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a94994cb-7d73-45fd-8d50-acacba46d495-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.566335 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.566316 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfbkt\" (UniqueName: \"kubernetes.io/projected/a94994cb-7d73-45fd-8d50-acacba46d495-kube-api-access-vfbkt\") pod \"alertmanager-main-0\" (UID: \"a94994cb-7d73-45fd-8d50-acacba46d495\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.700935 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.700904 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:59:22.834451 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:22.834422 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:59:22.837418 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:59:22.837394 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94994cb_7d73_45fd_8d50_acacba46d495.slice/crio-d454de7e1aa85eab1f122372e00bb5135762f228cab6073d162ea9936e0f3a53 WatchSource:0}: Error finding container d454de7e1aa85eab1f122372e00bb5135762f228cab6073d162ea9936e0f3a53: Status 404 returned error can't find the container with id d454de7e1aa85eab1f122372e00bb5135762f228cab6073d162ea9936e0f3a53 Jul 18 00:59:23.334660 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:23.334626 2548 generic.go:356] "Generic (PLEG): container finished" podID="a94994cb-7d73-45fd-8d50-acacba46d495" containerID="ac875d92478be7567110bc7491238dd6c56b8e4ade8fb3354cd3425cff9857a3" exitCode=0 Jul 18 00:59:23.335133 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:23.334715 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94994cb-7d73-45fd-8d50-acacba46d495","Type":"ContainerDied","Data":"ac875d92478be7567110bc7491238dd6c56b8e4ade8fb3354cd3425cff9857a3"} Jul 18 00:59:23.335133 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:23.334802 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94994cb-7d73-45fd-8d50-acacba46d495","Type":"ContainerStarted","Data":"d454de7e1aa85eab1f122372e00bb5135762f228cab6073d162ea9936e0f3a53"} Jul 18 00:59:24.343128 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.343082 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94994cb-7d73-45fd-8d50-acacba46d495","Type":"ContainerStarted","Data":"0eb7c4d33d0776692551ea34a057b1098c98b73ad3e4f77f0169b6003387eb4a"} Jul 18 00:59:24.343480 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.343182 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94994cb-7d73-45fd-8d50-acacba46d495","Type":"ContainerStarted","Data":"0137b5eed33505d559c80341e0aeee0fb7255ecdd033379254fe3562c7e257ce"} Jul 18 00:59:24.343480 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.343210 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94994cb-7d73-45fd-8d50-acacba46d495","Type":"ContainerStarted","Data":"5a7097045815d6d48263bb0d6d8f3f7ea5d3cd455c27f9250d096bd0b964de97"} Jul 18 00:59:24.343480 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.343236 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94994cb-7d73-45fd-8d50-acacba46d495","Type":"ContainerStarted","Data":"10939fc173f0bea64d5e9807ddf7efbfa32acc12fb8571aad75b1cd58fc00809"} Jul 18 00:59:24.343480 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.343260 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94994cb-7d73-45fd-8d50-acacba46d495","Type":"ContainerStarted","Data":"7f5a64231f4cf8fd16da17d3ad60450f6e1c96de2254d68708256137d8619a01"} Jul 18 00:59:24.343480 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.343284 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94994cb-7d73-45fd-8d50-acacba46d495","Type":"ContainerStarted","Data":"485402b2574ac2cbb1e34d576be57132469e3ffb6b61fe56a3276ea267b3835c"} Jul 18 00:59:24.403221 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.403168 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.387831824 podStartE2EDuration="2.403152796s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.320972ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:59:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:59:24.400559526 +0000 UTC m=+146.456897061" watchObservedRunningTime="2026-07-18 00:59:24.403152796 +0000 UTC m=+146.459490393" Jul 18 00:59:24.827975 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.827939 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5"] Jul 18 00:59:24.830714 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.830695 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.833588 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.833563 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 18 00:59:24.833712 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.833624 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-794kv\"" Jul 18 00:59:24.833712 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.833641 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 18 00:59:24.833813 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.833714 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 18 00:59:24.833879 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.833866 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 18 00:59:24.834115 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.834085 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 18 00:59:24.838877 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.838846 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 18 00:59:24.846332 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.846310 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5"] Jul 18 00:59:24.878888 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.878852 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9413c535-cf91-440c-91fb-fdd2e1327589-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.879045 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.878923 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-telemeter-client-tls\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.879045 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.878962 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7sr7\" (UniqueName: \"kubernetes.io/projected/9413c535-cf91-440c-91fb-fdd2e1327589-kube-api-access-s7sr7\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.879045 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.879032 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-federate-client-tls\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.879192 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.879071 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.879192 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.879115 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9413c535-cf91-440c-91fb-fdd2e1327589-serving-certs-ca-bundle\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.879192 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.879172 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-secret-telemeter-client\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.879291 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.879198 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9413c535-cf91-440c-91fb-fdd2e1327589-metrics-client-ca\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.980066 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.980030 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-secret-telemeter-client\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.980262 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.980072 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9413c535-cf91-440c-91fb-fdd2e1327589-metrics-client-ca\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.980262 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.980136 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9413c535-cf91-440c-91fb-fdd2e1327589-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.980262 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.980180 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-telemeter-client-tls\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.980262 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.980212 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7sr7\" (UniqueName: \"kubernetes.io/projected/9413c535-cf91-440c-91fb-fdd2e1327589-kube-api-access-s7sr7\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.980480 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.980290 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-federate-client-tls\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.980480 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.980332 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.980480 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.980359 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9413c535-cf91-440c-91fb-fdd2e1327589-serving-certs-ca-bundle\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.980936 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.980908 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9413c535-cf91-440c-91fb-fdd2e1327589-metrics-client-ca\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.981120 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.980998 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9413c535-cf91-440c-91fb-fdd2e1327589-serving-certs-ca-bundle\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.981805 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.981783 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9413c535-cf91-440c-91fb-fdd2e1327589-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.984312 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.984284 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-federate-client-tls\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.984392 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.984294 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-telemeter-client-tls\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.984878 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.984857 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-secret-telemeter-client\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.985003 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.984980 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9413c535-cf91-440c-91fb-fdd2e1327589-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:24.994191 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:24.994160 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7sr7\" (UniqueName: \"kubernetes.io/projected/9413c535-cf91-440c-91fb-fdd2e1327589-kube-api-access-s7sr7\") pod \"telemeter-client-67c55bdc5f-2rpp5\" (UID: \"9413c535-cf91-440c-91fb-fdd2e1327589\") " pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:25.111920 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.111823 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 00:59:25.112486 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.112287 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a8abe579911e497bc12aabf50e240b941f655ab1788c7c3ccdb0ac55ddf39daf" gracePeriod=600 Jul 18 00:59:25.112486 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.112282 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="prometheus" containerID="cri-o://7e231a1ee7ec41be3fa0b578812f949258a6e505d01ebbe19266cf96d2e12e78" gracePeriod=600 Jul 18 00:59:25.112486 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.112324 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy" containerID="cri-o://0f518c9d198a18a2cdfc0bb4e2d249c1374bec651dae2f49bb17d053c4aaca96" gracePeriod=600 Jul 18 00:59:25.112486 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.112346 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="config-reloader" containerID="cri-o://6fe6021454c98d8c793799edcff48b106b9acc960761bdb7f7f57965f9036a11" gracePeriod=600 Jul 18 00:59:25.112486 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.112280 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy-web" containerID="cri-o://39c3f7bb621eccfdb99f154493ff92e3ca2d5d6f74e393f0732a786df31c0fbf" gracePeriod=600 Jul 18 00:59:25.112486 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.112322 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="thanos-sidecar" containerID="cri-o://018fdc07a3b392fc7e7775f4326bc810d2eb89816af689a1f8c860b7f0b4f952" gracePeriod=600 Jul 18 00:59:25.143280 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.143241 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" Jul 18 00:59:25.299940 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:59:25.299914 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9413c535_cf91_440c_91fb_fdd2e1327589.slice/crio-472ae91cacadb227ad9e13b5928a3df863d698eed0b63503e9a07d2d65c75dff WatchSource:0}: Error finding container 472ae91cacadb227ad9e13b5928a3df863d698eed0b63503e9a07d2d65c75dff: Status 404 returned error can't find the container with id 472ae91cacadb227ad9e13b5928a3df863d698eed0b63503e9a07d2d65c75dff Jul 18 00:59:25.300111 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.299999 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5"] Jul 18 00:59:25.350542 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.350511 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" event={"ID":"9413c535-cf91-440c-91fb-fdd2e1327589","Type":"ContainerStarted","Data":"472ae91cacadb227ad9e13b5928a3df863d698eed0b63503e9a07d2d65c75dff"} Jul 18 00:59:25.355866 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.354325 2548 generic.go:356] "Generic (PLEG): container finished" podID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerID="a8abe579911e497bc12aabf50e240b941f655ab1788c7c3ccdb0ac55ddf39daf" exitCode=0 Jul 18 00:59:25.355866 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.354349 2548 generic.go:356] "Generic (PLEG): container finished" podID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerID="0f518c9d198a18a2cdfc0bb4e2d249c1374bec651dae2f49bb17d053c4aaca96" exitCode=0 Jul 18 00:59:25.355866 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.354359 2548 generic.go:356] "Generic (PLEG): container finished" podID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerID="018fdc07a3b392fc7e7775f4326bc810d2eb89816af689a1f8c860b7f0b4f952" exitCode=0 Jul 18 00:59:25.355866 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.354368 2548 generic.go:356] "Generic (PLEG): container finished" podID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerID="6fe6021454c98d8c793799edcff48b106b9acc960761bdb7f7f57965f9036a11" exitCode=0 Jul 18 00:59:25.355866 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.354377 2548 generic.go:356] "Generic (PLEG): container finished" podID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerID="7e231a1ee7ec41be3fa0b578812f949258a6e505d01ebbe19266cf96d2e12e78" exitCode=0 Jul 18 00:59:25.356198 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.355927 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerDied","Data":"a8abe579911e497bc12aabf50e240b941f655ab1788c7c3ccdb0ac55ddf39daf"} Jul 18 00:59:25.356198 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.356084 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerDied","Data":"0f518c9d198a18a2cdfc0bb4e2d249c1374bec651dae2f49bb17d053c4aaca96"} Jul 18 00:59:25.356198 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.356182 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerDied","Data":"018fdc07a3b392fc7e7775f4326bc810d2eb89816af689a1f8c860b7f0b4f952"} Jul 18 00:59:25.356327 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.356257 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerDied","Data":"6fe6021454c98d8c793799edcff48b106b9acc960761bdb7f7f57965f9036a11"} Jul 18 00:59:25.356422 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:25.356333 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerDied","Data":"7e231a1ee7ec41be3fa0b578812f949258a6e505d01ebbe19266cf96d2e12e78"} Jul 18 00:59:26.364599 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.364563 2548 generic.go:356] "Generic (PLEG): container finished" podID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerID="39c3f7bb621eccfdb99f154493ff92e3ca2d5d6f74e393f0732a786df31c0fbf" exitCode=0 Jul 18 00:59:26.364599 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.364593 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerDied","Data":"39c3f7bb621eccfdb99f154493ff92e3ca2d5d6f74e393f0732a786df31c0fbf"} Jul 18 00:59:26.365084 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.364663 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4841908b-1bbb-4c64-a43b-2d1588fdb156","Type":"ContainerDied","Data":"04a0ab7dab929013786237511e6992c8105a2fdd4d6a17bfab8c281632d8d755"} Jul 18 00:59:26.365084 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.364708 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04a0ab7dab929013786237511e6992c8105a2fdd4d6a17bfab8c281632d8d755" Jul 18 00:59:26.368147 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.368126 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:26.391151 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391130 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qkcz\" (UniqueName: \"kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-kube-api-access-8qkcz\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391288 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391163 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-kube-rbac-proxy\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391288 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391188 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-metrics-client-certs\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391288 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391212 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391288 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391269 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-trusted-ca-bundle\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391296 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-grpc-tls\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391327 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-serving-certs-ca-bundle\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391350 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-tls-assets\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391385 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-0\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391418 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-metrics-client-ca\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391445 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-config-out\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391469 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-2\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391505 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391500 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391904 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391529 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-config\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391904 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391589 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-1\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391904 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391622 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-db\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391904 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391647 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-tls\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391904 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391692 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-web-config\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391904 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391744 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-kubelet-serving-ca-bundle\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.391904 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.391769 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-thanos-prometheus-http-client-file\") pod \"4841908b-1bbb-4c64-a43b-2d1588fdb156\" (UID: \"4841908b-1bbb-4c64-a43b-2d1588fdb156\") " Jul 18 00:59:26.392433 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.392402 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:59:26.393410 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.393387 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:59:26.393648 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.393534 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:59:26.394297 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.394122 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:59:26.395269 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.395137 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:59:26.395269 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.395216 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:59:26.395475 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.395433 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:59:26.395547 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.395469 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:59:26.396253 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.396218 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:26.396691 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.396341 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:26.396691 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.396507 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:26.396691 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.396669 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-kube-api-access-8qkcz" (OuterVolumeSpecName: "kube-api-access-8qkcz") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "kube-api-access-8qkcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:59:26.396691 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.396724 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:26.396691 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.396734 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-config-out" (OuterVolumeSpecName: "config-out") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:59:26.397084 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.396863 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:26.397084 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.397071 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-config" (OuterVolumeSpecName: "config") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:26.397371 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.397332 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:26.397451 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.397409 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:26.399290 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.398977 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:59:26.412966 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.412910 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-web-config" (OuterVolumeSpecName: "web-config") pod "4841908b-1bbb-4c64-a43b-2d1588fdb156" (UID: "4841908b-1bbb-4c64-a43b-2d1588fdb156"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:59:26.492655 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492630 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492655 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492655 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-db\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492665 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492674 2548 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-web-config\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492684 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492693 2548 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492703 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qkcz\" (UniqueName: \"kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-kube-api-access-8qkcz\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492711 2548 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-kube-rbac-proxy\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492720 2548 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-metrics-client-certs\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492728 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492737 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492745 2548 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-grpc-tls\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492754 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492762 2548 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4841908b-1bbb-4c64-a43b-2d1588fdb156-tls-assets\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492770 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492777 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-configmap-metrics-client-ca\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492785 2548 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4841908b-1bbb-4c64-a43b-2d1588fdb156-config-out\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492793 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4841908b-1bbb-4c64-a43b-2d1588fdb156-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492802 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:26.492820 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:26.492810 2548 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4841908b-1bbb-4c64-a43b-2d1588fdb156-config\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 00:59:27.370733 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.370699 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" event={"ID":"9413c535-cf91-440c-91fb-fdd2e1327589","Type":"ContainerStarted","Data":"aa7c98ab42861aaf602f80291265871629b268d86819b235e997869f9dbf7302"} Jul 18 00:59:27.371171 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.370753 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" event={"ID":"9413c535-cf91-440c-91fb-fdd2e1327589","Type":"ContainerStarted","Data":"1e7fdb6d5a1195d7d91c2dbd6d60b74d4e61dcf92e637302aef361eceb12a327"} Jul 18 00:59:27.371171 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.370757 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.371171 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.370773 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" event={"ID":"9413c535-cf91-440c-91fb-fdd2e1327589","Type":"ContainerStarted","Data":"80b78dc4e98f147ab651977ce9ddcb39c0186beba8379dc8273a9b5e4c840f14"} Jul 18 00:59:27.395872 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.395817 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67c55bdc5f-2rpp5" podStartSLOduration=1.752505723 podStartE2EDuration="3.395802143s" totalImagesPullingTime="1.64329642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:59:27.392889073 +0000 UTC m=+149.449226605" watchObservedRunningTime="2026-07-18 00:59:27.395802143 +0000 UTC m=+149.452139675" Jul 18 00:59:27.411145 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.411113 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 00:59:27.417793 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.417772 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 00:59:27.447344 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447321 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 00:59:27.447619 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447607 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy-web" Jul 18 00:59:27.447663 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447621 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy-web" Jul 18 00:59:27.447663 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447634 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="thanos-sidecar" Jul 18 00:59:27.447663 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447639 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="thanos-sidecar" Jul 18 00:59:27.447663 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447646 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy-thanos" Jul 18 00:59:27.447663 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447651 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy-thanos" Jul 18 00:59:27.447663 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447665 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="config-reloader" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447695 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="config-reloader" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447707 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447712 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447718 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="init-config-reloader" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447724 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="init-config-reloader" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447730 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="prometheus" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447734 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="prometheus" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447779 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy-web" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447787 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="thanos-sidecar" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447793 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447799 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="kube-rbac-proxy-thanos" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447805 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="config-reloader" Jul 18 00:59:27.447826 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.447813 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" containerName="prometheus" Jul 18 00:59:27.450129 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.450114 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.455452 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.455433 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c1604rvs1n2a5\"" Jul 18 00:59:27.459419 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459250 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 18 00:59:27.459419 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459280 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 18 00:59:27.459419 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459289 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 18 00:59:27.459419 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459304 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 18 00:59:27.459419 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459336 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 18 00:59:27.459419 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459282 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 18 00:59:27.459419 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459309 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 18 00:59:27.459419 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459382 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 18 00:59:27.459744 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459614 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9w52d\"" Jul 18 00:59:27.459744 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459697 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 18 00:59:27.459830 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459782 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 18 00:59:27.459876 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.459867 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 18 00:59:27.460660 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.460648 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 18 00:59:27.465160 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.465144 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 18 00:59:27.487910 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.487886 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 18 00:59:27.501973 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.501951 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502038 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.501978 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502038 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.501997 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502038 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502028 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502169 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502051 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502169 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502071 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502169 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502090 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/572fb4f4-0259-410e-afcf-df0ef75ec24a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502266 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502166 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/572fb4f4-0259-410e-afcf-df0ef75ec24a-config-out\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502266 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502186 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502266 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502209 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502266 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502232 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-web-config\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502266 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502254 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502455 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502294 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502455 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502318 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502565 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502486 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5wtn\" (UniqueName: \"kubernetes.io/projected/572fb4f4-0259-410e-afcf-df0ef75ec24a-kube-api-access-z5wtn\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502565 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502525 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-config\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502657 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502566 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502657 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502594 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502657 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502639 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.502771 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.502657 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.509891 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.509871 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 00:59:27.603377 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603351 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5wtn\" (UniqueName: \"kubernetes.io/projected/572fb4f4-0259-410e-afcf-df0ef75ec24a-kube-api-access-z5wtn\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603377 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603382 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-config\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603580 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603399 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603580 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603418 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603580 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603456 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603580 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603478 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603580 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603536 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603580 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603564 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603584 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603612 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603633 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603663 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603692 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/572fb4f4-0259-410e-afcf-df0ef75ec24a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603721 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/572fb4f4-0259-410e-afcf-df0ef75ec24a-config-out\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603749 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603772 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603794 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-web-config\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603817 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.603854 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603848 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.604425 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.603873 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.604425 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.604066 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.604425 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.604293 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.604934 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.604900 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.607031 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.607010 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.607128 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.607063 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.607128 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.607068 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.607204 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.607156 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.607920 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.607547 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-config\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.607920 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.607886 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.608112 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.608074 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.608360 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.608335 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.608440 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.608355 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.608628 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.608584 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.608628 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.608620 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/572fb4f4-0259-410e-afcf-df0ef75ec24a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.609306 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.609286 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/572fb4f4-0259-410e-afcf-df0ef75ec24a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.609374 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.609362 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/572fb4f4-0259-410e-afcf-df0ef75ec24a-config-out\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.609644 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.609630 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-web-config\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.610307 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.610289 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.610373 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.610339 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/572fb4f4-0259-410e-afcf-df0ef75ec24a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.612322 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.612301 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5wtn\" (UniqueName: \"kubernetes.io/projected/572fb4f4-0259-410e-afcf-df0ef75ec24a-kube-api-access-z5wtn\") pod \"prometheus-k8s-0\" (UID: \"572fb4f4-0259-410e-afcf-df0ef75ec24a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.759723 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.759692 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 00:59:27.909710 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:27.909669 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 00:59:27.912577 ip-10-0-140-116 kubenswrapper[2548]: W0718 00:59:27.912554 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572fb4f4_0259_410e_afcf_df0ef75ec24a.slice/crio-f1e3a176262a5c10e30febc501b2034bb45dedcbedf6c40c5c8520df855bec2e WatchSource:0}: Error finding container f1e3a176262a5c10e30febc501b2034bb45dedcbedf6c40c5c8520df855bec2e: Status 404 returned error can't find the container with id f1e3a176262a5c10e30febc501b2034bb45dedcbedf6c40c5c8520df855bec2e Jul 18 00:59:28.378866 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:28.378779 2548 generic.go:356] "Generic (PLEG): container finished" podID="572fb4f4-0259-410e-afcf-df0ef75ec24a" containerID="39fd6966f89cc356fc8d9b42e9a4a0c847a37da4168c4c7af1e6c341aebd448b" exitCode=0 Jul 18 00:59:28.379214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:28.378876 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"572fb4f4-0259-410e-afcf-df0ef75ec24a","Type":"ContainerDied","Data":"39fd6966f89cc356fc8d9b42e9a4a0c847a37da4168c4c7af1e6c341aebd448b"} Jul 18 00:59:28.379214 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:28.378941 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"572fb4f4-0259-410e-afcf-df0ef75ec24a","Type":"ContainerStarted","Data":"f1e3a176262a5c10e30febc501b2034bb45dedcbedf6c40c5c8520df855bec2e"} Jul 18 00:59:28.478525 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:28.478500 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4841908b-1bbb-4c64-a43b-2d1588fdb156" path="/var/lib/kubelet/pods/4841908b-1bbb-4c64-a43b-2d1588fdb156/volumes" Jul 18 00:59:29.386422 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:29.386388 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"572fb4f4-0259-410e-afcf-df0ef75ec24a","Type":"ContainerStarted","Data":"d57aced39ffb61c89c70fc048d1fe7f75bde8386a8894110863a699ab060d23b"} Jul 18 00:59:29.386855 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:29.386449 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"572fb4f4-0259-410e-afcf-df0ef75ec24a","Type":"ContainerStarted","Data":"1386238ebb9c8c3be8155e24b557541c63af4529fd999dc8cce4dfae4e83024d"} Jul 18 00:59:29.386855 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:29.386482 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"572fb4f4-0259-410e-afcf-df0ef75ec24a","Type":"ContainerStarted","Data":"f7c13a67b379d0d24fb7f3bd8418aaad5380ebdbcd558c01cc905fd62004aba8"} Jul 18 00:59:29.386855 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:29.386506 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"572fb4f4-0259-410e-afcf-df0ef75ec24a","Type":"ContainerStarted","Data":"ac38b5c9d4533e3d85f53b0eab96bed8089d23c4fbe06c7df3a16d349142f60a"} Jul 18 00:59:29.386855 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:29.386531 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"572fb4f4-0259-410e-afcf-df0ef75ec24a","Type":"ContainerStarted","Data":"3a27ff78291fe5c115b9c0ee1a95b51c84810763ae57e4a79e18333e12a28af3"} Jul 18 00:59:29.386855 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:29.386554 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"572fb4f4-0259-410e-afcf-df0ef75ec24a","Type":"ContainerStarted","Data":"a329e740b07cb65df89ffeaeb0139fac1b810d2c475341fead82e73ad0c7f48b"} Jul 18 00:59:29.416864 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:29.416812 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.397737041 podStartE2EDuration="2.416796923s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.059882ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:59:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:59:29.414423441 +0000 UTC m=+151.470760995" watchObservedRunningTime="2026-07-18 00:59:29.416796923 +0000 UTC m=+151.473134483" Jul 18 00:59:32.760593 ip-10-0-140-116 kubenswrapper[2548]: I0718 00:59:32.760549 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 01:00:27.760459 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:00:27.760425 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 01:00:27.776354 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:00:27.776329 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 01:00:28.642952 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:00:28.642925 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 01:01:55.576750 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.576714 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7smcl"] Jul 18 01:01:55.580029 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.580013 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" Jul 18 01:01:55.582875 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.582854 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 18 01:01:55.582994 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.582895 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 18 01:01:55.584249 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.584230 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-v9dnz\"" Jul 18 01:01:55.589629 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.589604 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7smcl"] Jul 18 01:01:55.675428 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.675396 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecd029b-7b42-415e-a13d-3cacb095e0db-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7smcl\" (UID: \"8ecd029b-7b42-415e-a13d-3cacb095e0db\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" Jul 18 01:01:55.675603 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.675449 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwjt\" (UniqueName: \"kubernetes.io/projected/8ecd029b-7b42-415e-a13d-3cacb095e0db-kube-api-access-ppwjt\") pod \"cert-manager-webhook-6486ffd997-7smcl\" (UID: \"8ecd029b-7b42-415e-a13d-3cacb095e0db\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" Jul 18 01:01:55.776349 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.776306 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwjt\" (UniqueName: \"kubernetes.io/projected/8ecd029b-7b42-415e-a13d-3cacb095e0db-kube-api-access-ppwjt\") pod \"cert-manager-webhook-6486ffd997-7smcl\" (UID: \"8ecd029b-7b42-415e-a13d-3cacb095e0db\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" Jul 18 01:01:55.776504 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.776405 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecd029b-7b42-415e-a13d-3cacb095e0db-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7smcl\" (UID: \"8ecd029b-7b42-415e-a13d-3cacb095e0db\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" Jul 18 01:01:55.785947 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.785913 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ecd029b-7b42-415e-a13d-3cacb095e0db-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7smcl\" (UID: \"8ecd029b-7b42-415e-a13d-3cacb095e0db\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" Jul 18 01:01:55.786073 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.785968 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwjt\" (UniqueName: \"kubernetes.io/projected/8ecd029b-7b42-415e-a13d-3cacb095e0db-kube-api-access-ppwjt\") pod \"cert-manager-webhook-6486ffd997-7smcl\" (UID: \"8ecd029b-7b42-415e-a13d-3cacb095e0db\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" Jul 18 01:01:55.902907 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:55.902838 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" Jul 18 01:01:56.039233 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:56.039211 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7smcl"] Jul 18 01:01:56.041307 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:01:56.041277 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ecd029b_7b42_415e_a13d_3cacb095e0db.slice/crio-7d14af87f9269aaa4ea6ead617db71de3278f8350748f292095d0cdda5fa1c27 WatchSource:0}: Error finding container 7d14af87f9269aaa4ea6ead617db71de3278f8350748f292095d0cdda5fa1c27: Status 404 returned error can't find the container with id 7d14af87f9269aaa4ea6ead617db71de3278f8350748f292095d0cdda5fa1c27 Jul 18 01:01:57.005081 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:57.005038 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" event={"ID":"8ecd029b-7b42-415e-a13d-3cacb095e0db","Type":"ContainerStarted","Data":"7d14af87f9269aaa4ea6ead617db71de3278f8350748f292095d0cdda5fa1c27"} Jul 18 01:01:59.021628 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:59.021602 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovn-acl-logging/0.log" Jul 18 01:01:59.023071 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:59.022123 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovn-acl-logging/0.log" Jul 18 01:01:59.024749 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:01:59.024735 2548 kubelet.go:1648] "Image garbage collection succeeded" Jul 18 01:02:00.019555 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:00.019517 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" event={"ID":"8ecd029b-7b42-415e-a13d-3cacb095e0db","Type":"ContainerStarted","Data":"d62b1a9691b2120489be3df6bc5acb3b7cd42413ee83d7db706bf45ec9f01501"} Jul 18 01:02:00.019725 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:00.019632 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" Jul 18 01:02:00.037829 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:00.037783 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" podStartSLOduration=2.023076573 podStartE2EDuration="5.03776847s" totalImagesPullingTime="3.014691897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:02:00.037111696 +0000 UTC m=+302.093449241" watchObservedRunningTime="2026-07-18 01:02:00.03776847 +0000 UTC m=+302.094106002" Jul 18 01:02:03.041405 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.041372 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jns96"] Jul 18 01:02:03.044686 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.044670 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jns96" Jul 18 01:02:03.047417 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.047395 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-h4t8l\"" Jul 18 01:02:03.053864 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.053837 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jns96"] Jul 18 01:02:03.135120 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.135064 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94ca0413-c7f8-4527-90e3-830fd5b7a42f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jns96\" (UID: \"94ca0413-c7f8-4527-90e3-830fd5b7a42f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jns96" Jul 18 01:02:03.135302 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.135133 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9lr8\" (UniqueName: \"kubernetes.io/projected/94ca0413-c7f8-4527-90e3-830fd5b7a42f-kube-api-access-g9lr8\") pod \"cert-manager-cainjector-559cdd8c87-jns96\" (UID: \"94ca0413-c7f8-4527-90e3-830fd5b7a42f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jns96" Jul 18 01:02:03.236223 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.236186 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94ca0413-c7f8-4527-90e3-830fd5b7a42f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jns96\" (UID: \"94ca0413-c7f8-4527-90e3-830fd5b7a42f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jns96" Jul 18 01:02:03.236223 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.236222 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9lr8\" (UniqueName: \"kubernetes.io/projected/94ca0413-c7f8-4527-90e3-830fd5b7a42f-kube-api-access-g9lr8\") pod \"cert-manager-cainjector-559cdd8c87-jns96\" (UID: \"94ca0413-c7f8-4527-90e3-830fd5b7a42f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jns96" Jul 18 01:02:03.245731 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.245708 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94ca0413-c7f8-4527-90e3-830fd5b7a42f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jns96\" (UID: \"94ca0413-c7f8-4527-90e3-830fd5b7a42f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jns96" Jul 18 01:02:03.245849 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.245772 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9lr8\" (UniqueName: \"kubernetes.io/projected/94ca0413-c7f8-4527-90e3-830fd5b7a42f-kube-api-access-g9lr8\") pod \"cert-manager-cainjector-559cdd8c87-jns96\" (UID: \"94ca0413-c7f8-4527-90e3-830fd5b7a42f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jns96" Jul 18 01:02:03.353740 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.353648 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jns96" Jul 18 01:02:03.479961 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:03.479943 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jns96"] Jul 18 01:02:03.481947 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:02:03.481906 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94ca0413_c7f8_4527_90e3_830fd5b7a42f.slice/crio-dd5df824b9cafd77648ac9d0b9e8ec6fb9699521f9c531c3d1a5ef93247b8077 WatchSource:0}: Error finding container dd5df824b9cafd77648ac9d0b9e8ec6fb9699521f9c531c3d1a5ef93247b8077: Status 404 returned error can't find the container with id dd5df824b9cafd77648ac9d0b9e8ec6fb9699521f9c531c3d1a5ef93247b8077 Jul 18 01:02:04.037607 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:04.037574 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jns96" event={"ID":"94ca0413-c7f8-4527-90e3-830fd5b7a42f","Type":"ContainerStarted","Data":"e90a3d0cbc4da7aaf9721b439af246c7c679a90a9da41cac5315b67f81d2a006"} Jul 18 01:02:04.037607 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:04.037610 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jns96" event={"ID":"94ca0413-c7f8-4527-90e3-830fd5b7a42f","Type":"ContainerStarted","Data":"dd5df824b9cafd77648ac9d0b9e8ec6fb9699521f9c531c3d1a5ef93247b8077"} Jul 18 01:02:04.055486 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:04.055435 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jns96" podStartSLOduration=1.055421205 podStartE2EDuration="1.055421205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:02:04.054319046 +0000 UTC m=+306.110656578" watchObservedRunningTime="2026-07-18 01:02:04.055421205 +0000 UTC m=+306.111758736" Jul 18 01:02:06.026810 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:06.026778 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7smcl" Jul 18 01:02:27.288772 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.288736 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4"] Jul 18 01:02:27.292426 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.292410 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.295428 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.295405 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 18 01:02:27.295880 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.295859 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 18 01:02:27.295975 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.295959 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zn4rx\"" Jul 18 01:02:27.296369 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.296347 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 18 01:02:27.296473 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.296387 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 18 01:02:27.309248 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.309214 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4"] Jul 18 01:02:27.438415 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.438389 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5c573f9-4847-444c-b906-3016d2c752b2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.438574 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.438498 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5c573f9-4847-444c-b906-3016d2c752b2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.438574 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.438533 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlh7m\" (UniqueName: \"kubernetes.io/projected/d5c573f9-4847-444c-b906-3016d2c752b2-kube-api-access-zlh7m\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.438574 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.438552 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5c573f9-4847-444c-b906-3016d2c752b2-tmp\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.438574 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.438570 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5c573f9-4847-444c-b906-3016d2c752b2-manifests\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.540818 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.540049 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5c573f9-4847-444c-b906-3016d2c752b2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.540818 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.540141 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlh7m\" (UniqueName: \"kubernetes.io/projected/d5c573f9-4847-444c-b906-3016d2c752b2-kube-api-access-zlh7m\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.540818 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.540177 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5c573f9-4847-444c-b906-3016d2c752b2-tmp\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.540818 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.540209 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5c573f9-4847-444c-b906-3016d2c752b2-manifests\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.540818 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.540253 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5c573f9-4847-444c-b906-3016d2c752b2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.544355 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.543971 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5c573f9-4847-444c-b906-3016d2c752b2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.545510 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.545486 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5c573f9-4847-444c-b906-3016d2c752b2-manifests\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.546754 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.546730 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5c573f9-4847-444c-b906-3016d2c752b2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.547396 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.547375 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5c573f9-4847-444c-b906-3016d2c752b2-tmp\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.558023 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.558001 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlh7m\" (UniqueName: \"kubernetes.io/projected/d5c573f9-4847-444c-b906-3016d2c752b2-kube-api-access-zlh7m\") pod \"opendatahub-operator-controller-manager-5d5c9c876d-h7vq4\" (UID: \"d5c573f9-4847-444c-b906-3016d2c752b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.604227 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.604199 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:27.776844 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.776812 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4"] Jul 18 01:02:27.779241 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:02:27.779219 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c573f9_4847_444c_b906_3016d2c752b2.slice/crio-ba329af0bff383e361226db179419bf69e8a79e9ac4dcf81184a38d4b1b62b72 WatchSource:0}: Error finding container ba329af0bff383e361226db179419bf69e8a79e9ac4dcf81184a38d4b1b62b72: Status 404 returned error can't find the container with id ba329af0bff383e361226db179419bf69e8a79e9ac4dcf81184a38d4b1b62b72 Jul 18 01:02:27.780972 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:27.780957 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 01:02:28.154881 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:28.154846 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" event={"ID":"d5c573f9-4847-444c-b906-3016d2c752b2","Type":"ContainerStarted","Data":"ba329af0bff383e361226db179419bf69e8a79e9ac4dcf81184a38d4b1b62b72"} Jul 18 01:02:31.172841 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:31.172805 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" event={"ID":"d5c573f9-4847-444c-b906-3016d2c752b2","Type":"ContainerStarted","Data":"0df0c91d7e69525ccd7b329d474f7d915ccf53d680cd64bd75084d8153912530"} Jul 18 01:02:32.178831 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:32.178798 2548 generic.go:356] "Generic (PLEG): container finished" podID="d5c573f9-4847-444c-b906-3016d2c752b2" containerID="0df0c91d7e69525ccd7b329d474f7d915ccf53d680cd64bd75084d8153912530" exitCode=0 Jul 18 01:02:32.179268 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:32.178887 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" event={"ID":"d5c573f9-4847-444c-b906-3016d2c752b2","Type":"ContainerDied","Data":"0df0c91d7e69525ccd7b329d474f7d915ccf53d680cd64bd75084d8153912530"} Jul 18 01:02:33.185785 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:33.185750 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" event={"ID":"d5c573f9-4847-444c-b906-3016d2c752b2","Type":"ContainerStarted","Data":"7689a6fc42d98627ebaeb1359aea5d030bb92e3ef5ec4b0c374d2405bc5fca4d"} Jul 18 01:02:33.186405 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:33.185896 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:33.214042 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:33.213982 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" podStartSLOduration=1.886552956 podStartE2EDuration="6.213963772s" totalImagesPullingTime="3.292445846s" totalInitContainerRuntime="1.03496497s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:02:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:02:33.211687482 +0000 UTC m=+335.268025014" watchObservedRunningTime="2026-07-18 01:02:33.213963772 +0000 UTC m=+335.270301304" Jul 18 01:02:44.192673 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:44.192643 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d5c9c876d-h7vq4" Jul 18 01:02:46.156641 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.156609 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs"] Jul 18 01:02:46.162778 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.162750 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.166232 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.166209 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 18 01:02:46.167504 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.167485 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 18 01:02:46.167632 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.167504 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 18 01:02:46.167712 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.167504 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9c2rm\"" Jul 18 01:02:46.167712 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.167506 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 18 01:02:46.167712 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.167578 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 18 01:02:46.171769 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.171750 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs"] Jul 18 01:02:46.305460 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.305429 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/acc2a270-51c2-4233-9b38-cfc6acc409e0-manager-config\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.305460 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.305459 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/acc2a270-51c2-4233-9b38-cfc6acc409e0-metrics-cert\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.305696 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.305483 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acc2a270-51c2-4233-9b38-cfc6acc409e0-cert\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.305696 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.305638 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncsc2\" (UniqueName: \"kubernetes.io/projected/acc2a270-51c2-4233-9b38-cfc6acc409e0-kube-api-access-ncsc2\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.406790 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.406712 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/acc2a270-51c2-4233-9b38-cfc6acc409e0-manager-config\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.406790 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.406747 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/acc2a270-51c2-4233-9b38-cfc6acc409e0-metrics-cert\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.406790 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.406769 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acc2a270-51c2-4233-9b38-cfc6acc409e0-cert\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.407042 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.406825 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncsc2\" (UniqueName: \"kubernetes.io/projected/acc2a270-51c2-4233-9b38-cfc6acc409e0-kube-api-access-ncsc2\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.407446 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.407419 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/acc2a270-51c2-4233-9b38-cfc6acc409e0-manager-config\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.412441 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.412416 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/acc2a270-51c2-4233-9b38-cfc6acc409e0-metrics-cert\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.412560 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.412473 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acc2a270-51c2-4233-9b38-cfc6acc409e0-cert\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.424555 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.424522 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncsc2\" (UniqueName: \"kubernetes.io/projected/acc2a270-51c2-4233-9b38-cfc6acc409e0-kube-api-access-ncsc2\") pod \"lws-controller-manager-587945cbf9-2mrxs\" (UID: \"acc2a270-51c2-4233-9b38-cfc6acc409e0\") " pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.473128 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.473082 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:46.656385 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:46.656353 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs"] Jul 18 01:02:46.657838 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:02:46.657781 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc2a270_51c2_4233_9b38_cfc6acc409e0.slice/crio-fdb03020870760bd416830e4bad55a1388314aa40294325b4fcf64f29bb49f89 WatchSource:0}: Error finding container fdb03020870760bd416830e4bad55a1388314aa40294325b4fcf64f29bb49f89: Status 404 returned error can't find the container with id fdb03020870760bd416830e4bad55a1388314aa40294325b4fcf64f29bb49f89 Jul 18 01:02:47.087731 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.087698 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-595565d58b-z5lwj"] Jul 18 01:02:47.091518 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.091492 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" Jul 18 01:02:47.095087 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.095056 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 18 01:02:47.095250 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.095208 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 18 01:02:47.096304 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.096280 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nrqr5\"" Jul 18 01:02:47.096304 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.096285 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 18 01:02:47.096542 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.096287 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 18 01:02:47.105400 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.105380 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-595565d58b-z5lwj"] Jul 18 01:02:47.213756 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.213718 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/416e82ff-ebca-44c6-830c-bbcdbe551f4c-tls-certs\") pod \"kube-auth-proxy-595565d58b-z5lwj\" (UID: \"416e82ff-ebca-44c6-830c-bbcdbe551f4c\") " pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" Jul 18 01:02:47.213756 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.213752 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cw87\" (UniqueName: \"kubernetes.io/projected/416e82ff-ebca-44c6-830c-bbcdbe551f4c-kube-api-access-5cw87\") pod \"kube-auth-proxy-595565d58b-z5lwj\" (UID: \"416e82ff-ebca-44c6-830c-bbcdbe551f4c\") " pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" Jul 18 01:02:47.214200 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.213836 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/416e82ff-ebca-44c6-830c-bbcdbe551f4c-tmp\") pod \"kube-auth-proxy-595565d58b-z5lwj\" (UID: \"416e82ff-ebca-44c6-830c-bbcdbe551f4c\") " pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" Jul 18 01:02:47.252328 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.252291 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" event={"ID":"acc2a270-51c2-4233-9b38-cfc6acc409e0","Type":"ContainerStarted","Data":"fdb03020870760bd416830e4bad55a1388314aa40294325b4fcf64f29bb49f89"} Jul 18 01:02:47.314483 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.314431 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/416e82ff-ebca-44c6-830c-bbcdbe551f4c-tls-certs\") pod \"kube-auth-proxy-595565d58b-z5lwj\" (UID: \"416e82ff-ebca-44c6-830c-bbcdbe551f4c\") " pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" Jul 18 01:02:47.314483 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.314479 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cw87\" (UniqueName: \"kubernetes.io/projected/416e82ff-ebca-44c6-830c-bbcdbe551f4c-kube-api-access-5cw87\") pod \"kube-auth-proxy-595565d58b-z5lwj\" (UID: \"416e82ff-ebca-44c6-830c-bbcdbe551f4c\") " pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" Jul 18 01:02:47.314728 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.314557 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/416e82ff-ebca-44c6-830c-bbcdbe551f4c-tmp\") pod \"kube-auth-proxy-595565d58b-z5lwj\" (UID: \"416e82ff-ebca-44c6-830c-bbcdbe551f4c\") " pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" Jul 18 01:02:47.317647 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.317564 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/416e82ff-ebca-44c6-830c-bbcdbe551f4c-tmp\") pod \"kube-auth-proxy-595565d58b-z5lwj\" (UID: \"416e82ff-ebca-44c6-830c-bbcdbe551f4c\") " pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" Jul 18 01:02:47.317782 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.317729 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/416e82ff-ebca-44c6-830c-bbcdbe551f4c-tls-certs\") pod \"kube-auth-proxy-595565d58b-z5lwj\" (UID: \"416e82ff-ebca-44c6-830c-bbcdbe551f4c\") " pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" Jul 18 01:02:47.323493 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.323459 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cw87\" (UniqueName: \"kubernetes.io/projected/416e82ff-ebca-44c6-830c-bbcdbe551f4c-kube-api-access-5cw87\") pod \"kube-auth-proxy-595565d58b-z5lwj\" (UID: \"416e82ff-ebca-44c6-830c-bbcdbe551f4c\") " pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" Jul 18 01:02:47.403424 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.403340 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" Jul 18 01:02:47.564210 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:47.564168 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-595565d58b-z5lwj"] Jul 18 01:02:47.567990 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:02:47.567951 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416e82ff_ebca_44c6_830c_bbcdbe551f4c.slice/crio-dbad3d7430d95a9786c1d8d51d65f49ea069cb304118bd0f84a75bb5836e9693 WatchSource:0}: Error finding container dbad3d7430d95a9786c1d8d51d65f49ea069cb304118bd0f84a75bb5836e9693: Status 404 returned error can't find the container with id dbad3d7430d95a9786c1d8d51d65f49ea069cb304118bd0f84a75bb5836e9693 Jul 18 01:02:48.261952 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:48.261220 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" event={"ID":"416e82ff-ebca-44c6-830c-bbcdbe551f4c","Type":"ContainerStarted","Data":"dbad3d7430d95a9786c1d8d51d65f49ea069cb304118bd0f84a75bb5836e9693"} Jul 18 01:02:51.277893 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:51.277852 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" event={"ID":"416e82ff-ebca-44c6-830c-bbcdbe551f4c","Type":"ContainerStarted","Data":"e79b9ecf78f98bf10e09af3ea4274211719472049301f579eee3b4047f2b77ec"} Jul 18 01:02:51.279327 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:51.279298 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" event={"ID":"acc2a270-51c2-4233-9b38-cfc6acc409e0","Type":"ContainerStarted","Data":"5c776cc93b1cb81e01f89da720e8966c2afed190f775a6cd3d59ae8a0b684752"} Jul 18 01:02:51.279449 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:51.279419 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:02:51.296731 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:51.296666 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-595565d58b-z5lwj" podStartSLOduration=1.60779591 podStartE2EDuration="4.296648314s" totalImagesPullingTime="2.688852404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:02:51.294076592 +0000 UTC m=+353.350414125" watchObservedRunningTime="2026-07-18 01:02:51.296648314 +0000 UTC m=+353.352985847" Jul 18 01:02:51.314662 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:02:51.314603 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" podStartSLOduration=1.716286355 podStartE2EDuration="5.314546314s" totalImagesPullingTime="3.598259959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:02:51.312198419 +0000 UTC m=+353.368535952" watchObservedRunningTime="2026-07-18 01:02:51.314546314 +0000 UTC m=+353.370883847" Jul 18 01:03:02.287334 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:03:02.287302 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-587945cbf9-2mrxs" Jul 18 01:04:40.432620 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.432580 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r"] Jul 18 01:04:40.436199 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.436179 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:40.439584 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:04:40.439559 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-116.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-116.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 18 01:04:40.439778 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:04:40.439760 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kuadrant-operator-controller-manager-dockercfg-n65g2\" is forbidden: User \"system:node:ip-10-0-140-116.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-116.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n65g2\"" type="*v1.Secret" Jul 18 01:04:40.439827 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:04:40.439765 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6k6r\" is forbidden: User \"system:node:ip-10-0-140-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-116.ec2.internal' and this object" podUID="aa376c13-30a1-4abe-94c2-a2260f2f1c5d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:40.439865 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:04:40.439825 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-116.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-116.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 18 01:04:40.456977 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.456954 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r"] Jul 18 01:04:40.522656 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.522623 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkfkq\" (UniqueName: \"kubernetes.io/projected/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-kube-api-access-xkfkq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6k6r\" (UID: \"aa376c13-30a1-4abe-94c2-a2260f2f1c5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:40.522800 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.522673 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6k6r\" (UID: \"aa376c13-30a1-4abe-94c2-a2260f2f1c5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:40.614945 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.614909 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r"] Jul 18 01:04:40.615246 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:04:40.615216 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-xkfkq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" podUID="aa376c13-30a1-4abe-94c2-a2260f2f1c5d" Jul 18 01:04:40.623654 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.623632 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkfkq\" (UniqueName: \"kubernetes.io/projected/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-kube-api-access-xkfkq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6k6r\" (UID: \"aa376c13-30a1-4abe-94c2-a2260f2f1c5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:40.623761 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.623674 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6k6r\" (UID: \"aa376c13-30a1-4abe-94c2-a2260f2f1c5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:40.624071 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.624054 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6k6r\" (UID: \"aa376c13-30a1-4abe-94c2-a2260f2f1c5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:40.784924 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.784894 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:40.791591 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.791569 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:40.825738 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.825713 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-extensions-socket-volume\") pod \"aa376c13-30a1-4abe-94c2-a2260f2f1c5d\" (UID: \"aa376c13-30a1-4abe-94c2-a2260f2f1c5d\") " Jul 18 01:04:40.825958 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.825938 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa376c13-30a1-4abe-94c2-a2260f2f1c5d" (UID: "aa376c13-30a1-4abe-94c2-a2260f2f1c5d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:04:40.926781 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.926740 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-extensions-socket-volume\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:04:40.961722 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.961691 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r"] Jul 18 01:04:40.971564 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:40.971541 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r"] Jul 18 01:04:41.013347 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.013315 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6"] Jul 18 01:04:41.016888 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.016866 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:04:41.027217 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.027192 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6621f706-d3dd-41ee-a67c-1ced5266a15b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wmhd6\" (UID: \"6621f706-d3dd-41ee-a67c-1ced5266a15b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:04:41.027352 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.027234 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gzj2\" (UniqueName: \"kubernetes.io/projected/6621f706-d3dd-41ee-a67c-1ced5266a15b-kube-api-access-6gzj2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wmhd6\" (UID: \"6621f706-d3dd-41ee-a67c-1ced5266a15b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:04:41.030381 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.030356 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6"] Jul 18 01:04:41.128357 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.128268 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6621f706-d3dd-41ee-a67c-1ced5266a15b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wmhd6\" (UID: \"6621f706-d3dd-41ee-a67c-1ced5266a15b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:04:41.128357 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.128328 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gzj2\" (UniqueName: \"kubernetes.io/projected/6621f706-d3dd-41ee-a67c-1ced5266a15b-kube-api-access-6gzj2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wmhd6\" (UID: \"6621f706-d3dd-41ee-a67c-1ced5266a15b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:04:41.128667 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.128650 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6621f706-d3dd-41ee-a67c-1ced5266a15b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wmhd6\" (UID: \"6621f706-d3dd-41ee-a67c-1ced5266a15b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:04:41.250472 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.250442 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 18 01:04:41.342319 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.342290 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n65g2\"" Jul 18 01:04:41.789474 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.789445 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:41.792445 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:04:41.792419 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6k6r\" is forbidden: User \"system:node:ip-10-0-140-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-116.ec2.internal' and this object" podUID="aa376c13-30a1-4abe-94c2-a2260f2f1c5d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:41.797188 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:04:41.797163 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6k6r\" is forbidden: User \"system:node:ip-10-0-140-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-116.ec2.internal' and this object" podUID="aa376c13-30a1-4abe-94c2-a2260f2f1c5d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:41.841592 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.841567 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 18 01:04:41.848370 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.848354 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gzj2\" (UniqueName: \"kubernetes.io/projected/6621f706-d3dd-41ee-a67c-1ced5266a15b-kube-api-access-6gzj2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wmhd6\" (UID: \"6621f706-d3dd-41ee-a67c-1ced5266a15b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:04:41.854281 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.854260 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkfkq\" (UniqueName: \"kubernetes.io/projected/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-kube-api-access-xkfkq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6k6r\" (UID: \"aa376c13-30a1-4abe-94c2-a2260f2f1c5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6k6r" Jul 18 01:04:41.927321 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.927289 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:04:41.933572 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.933554 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkfkq\" (UniqueName: \"kubernetes.io/projected/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-kube-api-access-xkfkq\") pod \"aa376c13-30a1-4abe-94c2-a2260f2f1c5d\" (UID: \"aa376c13-30a1-4abe-94c2-a2260f2f1c5d\") " Jul 18 01:04:41.935637 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:41.935605 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-kube-api-access-xkfkq" (OuterVolumeSpecName: "kube-api-access-xkfkq") pod "aa376c13-30a1-4abe-94c2-a2260f2f1c5d" (UID: "aa376c13-30a1-4abe-94c2-a2260f2f1c5d"). InnerVolumeSpecName "kube-api-access-xkfkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:04:42.034716 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:42.034687 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkfkq\" (UniqueName: \"kubernetes.io/projected/aa376c13-30a1-4abe-94c2-a2260f2f1c5d-kube-api-access-xkfkq\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:04:42.063168 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:42.063139 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6"] Jul 18 01:04:42.065911 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:04:42.065885 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6621f706_d3dd_41ee_a67c_1ced5266a15b.slice/crio-5c91265b66137359d6c5e47f289b315db305625f71bfdcca56f5284914059526 WatchSource:0}: Error finding container 5c91265b66137359d6c5e47f289b315db305625f71bfdcca56f5284914059526: Status 404 returned error can't find the container with id 5c91265b66137359d6c5e47f289b315db305625f71bfdcca56f5284914059526 Jul 18 01:04:42.478751 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:42.478720 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa376c13-30a1-4abe-94c2-a2260f2f1c5d" path="/var/lib/kubelet/pods/aa376c13-30a1-4abe-94c2-a2260f2f1c5d/volumes" Jul 18 01:04:42.798326 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:42.798235 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" event={"ID":"6621f706-d3dd-41ee-a67c-1ced5266a15b","Type":"ContainerStarted","Data":"5c91265b66137359d6c5e47f289b315db305625f71bfdcca56f5284914059526"} Jul 18 01:04:46.820857 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:46.820817 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" event={"ID":"6621f706-d3dd-41ee-a67c-1ced5266a15b","Type":"ContainerStarted","Data":"cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9"} Jul 18 01:04:46.821272 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:46.820955 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:04:46.842772 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:46.842720 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" podStartSLOduration=2.7602796979999997 podStartE2EDuration="6.842707995s" totalImagesPullingTime="4.082428297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:04:46.840714141 +0000 UTC m=+468.897051672" watchObservedRunningTime="2026-07-18 01:04:46.842707995 +0000 UTC m=+468.899045526" Jul 18 01:04:57.828475 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:57.828442 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:04:58.349453 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:58.349421 2548 scope.go:117] "RemoveContainer" containerID="36105313a28f83f092e64182a7eb509ba7060bbaecbbde71e307acda1ea94f93" Jul 18 01:04:58.357684 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:58.357667 2548 scope.go:117] "RemoveContainer" containerID="a8abe579911e497bc12aabf50e240b941f655ab1788c7c3ccdb0ac55ddf39daf" Jul 18 01:04:58.364957 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:58.364932 2548 scope.go:117] "RemoveContainer" containerID="6fe6021454c98d8c793799edcff48b106b9acc960761bdb7f7f57965f9036a11" Jul 18 01:04:58.371800 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:58.371783 2548 scope.go:117] "RemoveContainer" containerID="0f518c9d198a18a2cdfc0bb4e2d249c1374bec651dae2f49bb17d053c4aaca96" Jul 18 01:04:58.378415 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:58.378399 2548 scope.go:117] "RemoveContainer" containerID="39c3f7bb621eccfdb99f154493ff92e3ca2d5d6f74e393f0732a786df31c0fbf" Jul 18 01:04:58.385240 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:58.385222 2548 scope.go:117] "RemoveContainer" containerID="018fdc07a3b392fc7e7775f4326bc810d2eb89816af689a1f8c860b7f0b4f952" Jul 18 01:04:58.392018 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:04:58.392004 2548 scope.go:117] "RemoveContainer" containerID="7e231a1ee7ec41be3fa0b578812f949258a6e505d01ebbe19266cf96d2e12e78" Jul 18 01:05:06.485685 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.485655 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6"] Jul 18 01:05:06.486083 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.485937 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" podUID="6621f706-d3dd-41ee-a67c-1ced5266a15b" containerName="manager" containerID="cri-o://cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9" gracePeriod=10 Jul 18 01:05:06.740648 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.740588 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:05:06.854115 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.854073 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6621f706-d3dd-41ee-a67c-1ced5266a15b-extensions-socket-volume\") pod \"6621f706-d3dd-41ee-a67c-1ced5266a15b\" (UID: \"6621f706-d3dd-41ee-a67c-1ced5266a15b\") " Jul 18 01:05:06.854298 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.854139 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gzj2\" (UniqueName: \"kubernetes.io/projected/6621f706-d3dd-41ee-a67c-1ced5266a15b-kube-api-access-6gzj2\") pod \"6621f706-d3dd-41ee-a67c-1ced5266a15b\" (UID: \"6621f706-d3dd-41ee-a67c-1ced5266a15b\") " Jul 18 01:05:06.854444 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.854416 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6621f706-d3dd-41ee-a67c-1ced5266a15b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6621f706-d3dd-41ee-a67c-1ced5266a15b" (UID: "6621f706-d3dd-41ee-a67c-1ced5266a15b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:05:06.856519 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.856493 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6621f706-d3dd-41ee-a67c-1ced5266a15b-kube-api-access-6gzj2" (OuterVolumeSpecName: "kube-api-access-6gzj2") pod "6621f706-d3dd-41ee-a67c-1ced5266a15b" (UID: "6621f706-d3dd-41ee-a67c-1ced5266a15b"). InnerVolumeSpecName "kube-api-access-6gzj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:05:06.917503 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.917469 2548 generic.go:356] "Generic (PLEG): container finished" podID="6621f706-d3dd-41ee-a67c-1ced5266a15b" containerID="cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9" exitCode=0 Jul 18 01:05:06.917686 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.917516 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" Jul 18 01:05:06.917686 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.917569 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" event={"ID":"6621f706-d3dd-41ee-a67c-1ced5266a15b","Type":"ContainerDied","Data":"cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9"} Jul 18 01:05:06.917686 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.917629 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6" event={"ID":"6621f706-d3dd-41ee-a67c-1ced5266a15b","Type":"ContainerDied","Data":"5c91265b66137359d6c5e47f289b315db305625f71bfdcca56f5284914059526"} Jul 18 01:05:06.917686 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.917658 2548 scope.go:117] "RemoveContainer" containerID="cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9" Jul 18 01:05:06.932552 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.932517 2548 scope.go:117] "RemoveContainer" containerID="cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9" Jul 18 01:05:06.932848 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:05:06.932826 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9\": container with ID starting with cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9 not found: ID does not exist" containerID="cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9" Jul 18 01:05:06.932910 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.932857 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9"} err="failed to get container status \"cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9\": rpc error: code = NotFound desc = could not find container \"cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9\": container with ID starting with cc1fe8227622fc158e205a67d2e0d213a1767d0e4df385d61a5653120d79b6b9 not found: ID does not exist" Jul 18 01:05:06.951001 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.950974 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6"] Jul 18 01:05:06.953760 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.953738 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wmhd6"] Jul 18 01:05:06.955493 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.955476 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6621f706-d3dd-41ee-a67c-1ced5266a15b-extensions-socket-volume\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:05:06.955554 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:06.955497 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gzj2\" (UniqueName: \"kubernetes.io/projected/6621f706-d3dd-41ee-a67c-1ced5266a15b-kube-api-access-6gzj2\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:05:08.477601 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:08.477567 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6621f706-d3dd-41ee-a67c-1ced5266a15b" path="/var/lib/kubelet/pods/6621f706-d3dd-41ee-a67c-1ced5266a15b/volumes" Jul 18 01:05:26.330840 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.330806 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7txwn"] Jul 18 01:05:26.331328 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.331178 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6621f706-d3dd-41ee-a67c-1ced5266a15b" containerName="manager" Jul 18 01:05:26.331328 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.331189 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="6621f706-d3dd-41ee-a67c-1ced5266a15b" containerName="manager" Jul 18 01:05:26.331328 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.331256 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="6621f706-d3dd-41ee-a67c-1ced5266a15b" containerName="manager" Jul 18 01:05:26.333282 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.333260 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:26.336304 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.336280 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 18 01:05:26.336304 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.336283 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 18 01:05:26.336463 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.336283 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 18 01:05:26.337699 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.337681 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ngccl\"" Jul 18 01:05:26.343814 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.343792 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7txwn"] Jul 18 01:05:26.422466 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.422430 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qvbg\" (UniqueName: \"kubernetes.io/projected/c63795c5-2763-48bc-b2d9-45100d764a87-kube-api-access-6qvbg\") pod \"limitador-limitador-64c94fd64f-7txwn\" (UID: \"c63795c5-2763-48bc-b2d9-45100d764a87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:26.422645 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.422549 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c63795c5-2763-48bc-b2d9-45100d764a87-config-file\") pod \"limitador-limitador-64c94fd64f-7txwn\" (UID: \"c63795c5-2763-48bc-b2d9-45100d764a87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:26.436042 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.436012 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7txwn"] Jul 18 01:05:26.523766 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.523728 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c63795c5-2763-48bc-b2d9-45100d764a87-config-file\") pod \"limitador-limitador-64c94fd64f-7txwn\" (UID: \"c63795c5-2763-48bc-b2d9-45100d764a87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:26.523916 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.523820 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qvbg\" (UniqueName: \"kubernetes.io/projected/c63795c5-2763-48bc-b2d9-45100d764a87-kube-api-access-6qvbg\") pod \"limitador-limitador-64c94fd64f-7txwn\" (UID: \"c63795c5-2763-48bc-b2d9-45100d764a87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:26.524433 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.524416 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c63795c5-2763-48bc-b2d9-45100d764a87-config-file\") pod \"limitador-limitador-64c94fd64f-7txwn\" (UID: \"c63795c5-2763-48bc-b2d9-45100d764a87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:26.532900 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.532878 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qvbg\" (UniqueName: \"kubernetes.io/projected/c63795c5-2763-48bc-b2d9-45100d764a87-kube-api-access-6qvbg\") pod \"limitador-limitador-64c94fd64f-7txwn\" (UID: \"c63795c5-2763-48bc-b2d9-45100d764a87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:26.643626 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.643560 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:26.775327 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:26.775305 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7txwn"] Jul 18 01:05:26.777442 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:05:26.777412 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63795c5_2763_48bc_b2d9_45100d764a87.slice/crio-58842c4ba4d3f4e0e5ccd0e3d7c25e2c764fb085d3f0a5bd51413aecb42155ae WatchSource:0}: Error finding container 58842c4ba4d3f4e0e5ccd0e3d7c25e2c764fb085d3f0a5bd51413aecb42155ae: Status 404 returned error can't find the container with id 58842c4ba4d3f4e0e5ccd0e3d7c25e2c764fb085d3f0a5bd51413aecb42155ae Jul 18 01:05:27.009414 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.009381 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" event={"ID":"c63795c5-2763-48bc-b2d9-45100d764a87","Type":"ContainerStarted","Data":"58842c4ba4d3f4e0e5ccd0e3d7c25e2c764fb085d3f0a5bd51413aecb42155ae"} Jul 18 01:05:27.188024 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.187991 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rhgvz"] Jul 18 01:05:27.191687 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.191665 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rhgvz" Jul 18 01:05:27.194526 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.194508 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-767cd\"" Jul 18 01:05:27.197521 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.197496 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rhgvz"] Jul 18 01:05:27.331889 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.331809 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnxvk\" (UniqueName: \"kubernetes.io/projected/85456878-420b-4e44-a9ba-0bf29668aa9c-kube-api-access-gnxvk\") pod \"authorino-58cd955675-rhgvz\" (UID: \"85456878-420b-4e44-a9ba-0bf29668aa9c\") " pod="kuadrant-system/authorino-58cd955675-rhgvz" Jul 18 01:05:27.401402 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.401367 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-q4m95"] Jul 18 01:05:27.406983 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.406956 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q4m95" Jul 18 01:05:27.410793 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.410766 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q4m95"] Jul 18 01:05:27.433195 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.433170 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnxvk\" (UniqueName: \"kubernetes.io/projected/85456878-420b-4e44-a9ba-0bf29668aa9c-kube-api-access-gnxvk\") pod \"authorino-58cd955675-rhgvz\" (UID: \"85456878-420b-4e44-a9ba-0bf29668aa9c\") " pod="kuadrant-system/authorino-58cd955675-rhgvz" Jul 18 01:05:27.441883 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.441817 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnxvk\" (UniqueName: \"kubernetes.io/projected/85456878-420b-4e44-a9ba-0bf29668aa9c-kube-api-access-gnxvk\") pod \"authorino-58cd955675-rhgvz\" (UID: \"85456878-420b-4e44-a9ba-0bf29668aa9c\") " pod="kuadrant-system/authorino-58cd955675-rhgvz" Jul 18 01:05:27.502422 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.502398 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rhgvz" Jul 18 01:05:27.534135 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.534084 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfn84\" (UniqueName: \"kubernetes.io/projected/777f17ab-47e0-4a8b-bb42-2ab1874fe79a-kube-api-access-hfn84\") pod \"authorino-75d556bd77-q4m95\" (UID: \"777f17ab-47e0-4a8b-bb42-2ab1874fe79a\") " pod="kuadrant-system/authorino-75d556bd77-q4m95" Jul 18 01:05:27.628194 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.628173 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rhgvz"] Jul 18 01:05:27.629701 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:05:27.629668 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85456878_420b_4e44_a9ba_0bf29668aa9c.slice/crio-e0143b336269302319e6afdc9164b5ddce3928cb6d40f2fe3f72e2bedc1d016b WatchSource:0}: Error finding container e0143b336269302319e6afdc9164b5ddce3928cb6d40f2fe3f72e2bedc1d016b: Status 404 returned error can't find the container with id e0143b336269302319e6afdc9164b5ddce3928cb6d40f2fe3f72e2bedc1d016b Jul 18 01:05:27.635558 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.635536 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfn84\" (UniqueName: \"kubernetes.io/projected/777f17ab-47e0-4a8b-bb42-2ab1874fe79a-kube-api-access-hfn84\") pod \"authorino-75d556bd77-q4m95\" (UID: \"777f17ab-47e0-4a8b-bb42-2ab1874fe79a\") " pod="kuadrant-system/authorino-75d556bd77-q4m95" Jul 18 01:05:27.644762 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.644732 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfn84\" (UniqueName: \"kubernetes.io/projected/777f17ab-47e0-4a8b-bb42-2ab1874fe79a-kube-api-access-hfn84\") pod \"authorino-75d556bd77-q4m95\" (UID: \"777f17ab-47e0-4a8b-bb42-2ab1874fe79a\") " pod="kuadrant-system/authorino-75d556bd77-q4m95" Jul 18 01:05:27.717048 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.717013 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q4m95" Jul 18 01:05:27.904689 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:27.904626 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q4m95"] Jul 18 01:05:27.906645 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:05:27.906610 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod777f17ab_47e0_4a8b_bb42_2ab1874fe79a.slice/crio-6508c94f1a090bf56c9d803e1ce8e527d424aedf2c24b6bc98812af32dc4eed1 WatchSource:0}: Error finding container 6508c94f1a090bf56c9d803e1ce8e527d424aedf2c24b6bc98812af32dc4eed1: Status 404 returned error can't find the container with id 6508c94f1a090bf56c9d803e1ce8e527d424aedf2c24b6bc98812af32dc4eed1 Jul 18 01:05:28.021875 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:28.021832 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rhgvz" event={"ID":"85456878-420b-4e44-a9ba-0bf29668aa9c","Type":"ContainerStarted","Data":"e0143b336269302319e6afdc9164b5ddce3928cb6d40f2fe3f72e2bedc1d016b"} Jul 18 01:05:28.024697 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:28.024668 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q4m95" event={"ID":"777f17ab-47e0-4a8b-bb42-2ab1874fe79a","Type":"ContainerStarted","Data":"6508c94f1a090bf56c9d803e1ce8e527d424aedf2c24b6bc98812af32dc4eed1"} Jul 18 01:05:33.053173 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:33.053131 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q4m95" event={"ID":"777f17ab-47e0-4a8b-bb42-2ab1874fe79a","Type":"ContainerStarted","Data":"8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733"} Jul 18 01:05:33.054708 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:33.054679 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" event={"ID":"c63795c5-2763-48bc-b2d9-45100d764a87","Type":"ContainerStarted","Data":"51c341bb3282f473cc759dc960459f84ad2b5e694dada1c73c8a8b83904acf4d"} Jul 18 01:05:33.054883 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:33.054740 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:33.055936 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:33.055916 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rhgvz" event={"ID":"85456878-420b-4e44-a9ba-0bf29668aa9c","Type":"ContainerStarted","Data":"2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111"} Jul 18 01:05:33.068444 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:33.068405 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-q4m95" podStartSLOduration=1.7906812890000001 podStartE2EDuration="6.068393317s" totalImagesPullingTime="4.277712028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:05:33.067127401 +0000 UTC m=+515.123464940" watchObservedRunningTime="2026-07-18 01:05:33.068393317 +0000 UTC m=+515.124730848" Jul 18 01:05:33.081894 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:33.081847 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rhgvz" podStartSLOduration=1.515531233 podStartE2EDuration="6.08183411s" totalImagesPullingTime="4.566302877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:05:33.080515646 +0000 UTC m=+515.136853178" watchObservedRunningTime="2026-07-18 01:05:33.08183411 +0000 UTC m=+515.138171680" Jul 18 01:05:33.105754 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:33.105704 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" podStartSLOduration=1.698638077 podStartE2EDuration="7.10569008s" totalImagesPullingTime="5.407052003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:05:33.104652976 +0000 UTC m=+515.160990509" watchObservedRunningTime="2026-07-18 01:05:33.10569008 +0000 UTC m=+515.162027662" Jul 18 01:05:33.112084 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:33.112061 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rhgvz"] Jul 18 01:05:35.065261 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:35.065220 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rhgvz" podUID="85456878-420b-4e44-a9ba-0bf29668aa9c" containerName="authorino" containerID="cri-o://2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111" gracePeriod=30 Jul 18 01:05:35.307400 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:35.307378 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rhgvz" Jul 18 01:05:35.410201 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:35.410109 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnxvk\" (UniqueName: \"kubernetes.io/projected/85456878-420b-4e44-a9ba-0bf29668aa9c-kube-api-access-gnxvk\") pod \"85456878-420b-4e44-a9ba-0bf29668aa9c\" (UID: \"85456878-420b-4e44-a9ba-0bf29668aa9c\") " Jul 18 01:05:35.412243 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:35.412217 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85456878-420b-4e44-a9ba-0bf29668aa9c-kube-api-access-gnxvk" (OuterVolumeSpecName: "kube-api-access-gnxvk") pod "85456878-420b-4e44-a9ba-0bf29668aa9c" (UID: "85456878-420b-4e44-a9ba-0bf29668aa9c"). InnerVolumeSpecName "kube-api-access-gnxvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:05:35.511001 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:35.510968 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnxvk\" (UniqueName: \"kubernetes.io/projected/85456878-420b-4e44-a9ba-0bf29668aa9c-kube-api-access-gnxvk\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:05:36.071250 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:36.071216 2548 generic.go:356] "Generic (PLEG): container finished" podID="85456878-420b-4e44-a9ba-0bf29668aa9c" containerID="2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111" exitCode=0 Jul 18 01:05:36.071644 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:36.071255 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rhgvz" Jul 18 01:05:36.071644 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:36.071308 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rhgvz" event={"ID":"85456878-420b-4e44-a9ba-0bf29668aa9c","Type":"ContainerDied","Data":"2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111"} Jul 18 01:05:36.071644 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:36.071349 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rhgvz" event={"ID":"85456878-420b-4e44-a9ba-0bf29668aa9c","Type":"ContainerDied","Data":"e0143b336269302319e6afdc9164b5ddce3928cb6d40f2fe3f72e2bedc1d016b"} Jul 18 01:05:36.071644 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:36.071369 2548 scope.go:117] "RemoveContainer" containerID="2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111" Jul 18 01:05:36.080316 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:36.080299 2548 scope.go:117] "RemoveContainer" containerID="2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111" Jul 18 01:05:36.080551 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:05:36.080536 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111\": container with ID starting with 2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111 not found: ID does not exist" containerID="2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111" Jul 18 01:05:36.080599 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:36.080560 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111"} err="failed to get container status \"2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111\": rpc error: code = NotFound desc = could not find container \"2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111\": container with ID starting with 2b0acd1cb4d3d91b63c535543c6c5b49114f19eea0cf8be5857c078bea709111 not found: ID does not exist" Jul 18 01:05:36.091621 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:36.091597 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rhgvz"] Jul 18 01:05:36.095141 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:36.095121 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rhgvz"] Jul 18 01:05:36.478227 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:36.478199 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85456878-420b-4e44-a9ba-0bf29668aa9c" path="/var/lib/kubelet/pods/85456878-420b-4e44-a9ba-0bf29668aa9c/volumes" Jul 18 01:05:41.644703 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:41.644672 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7txwn"] Jul 18 01:05:41.645159 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:41.644834 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" podUID="c63795c5-2763-48bc-b2d9-45100d764a87" containerName="limitador" containerID="cri-o://51c341bb3282f473cc759dc960459f84ad2b5e694dada1c73c8a8b83904acf4d" gracePeriod=30 Jul 18 01:05:41.646998 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:41.646973 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:42.101997 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:42.101966 2548 generic.go:356] "Generic (PLEG): container finished" podID="c63795c5-2763-48bc-b2d9-45100d764a87" containerID="51c341bb3282f473cc759dc960459f84ad2b5e694dada1c73c8a8b83904acf4d" exitCode=0 Jul 18 01:05:42.102197 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:42.102047 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" event={"ID":"c63795c5-2763-48bc-b2d9-45100d764a87","Type":"ContainerDied","Data":"51c341bb3282f473cc759dc960459f84ad2b5e694dada1c73c8a8b83904acf4d"} Jul 18 01:05:42.196965 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:42.196943 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:42.267751 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:42.267669 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qvbg\" (UniqueName: \"kubernetes.io/projected/c63795c5-2763-48bc-b2d9-45100d764a87-kube-api-access-6qvbg\") pod \"c63795c5-2763-48bc-b2d9-45100d764a87\" (UID: \"c63795c5-2763-48bc-b2d9-45100d764a87\") " Jul 18 01:05:42.267905 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:42.267772 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c63795c5-2763-48bc-b2d9-45100d764a87-config-file\") pod \"c63795c5-2763-48bc-b2d9-45100d764a87\" (UID: \"c63795c5-2763-48bc-b2d9-45100d764a87\") " Jul 18 01:05:42.268153 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:42.268132 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c63795c5-2763-48bc-b2d9-45100d764a87-config-file" (OuterVolumeSpecName: "config-file") pod "c63795c5-2763-48bc-b2d9-45100d764a87" (UID: "c63795c5-2763-48bc-b2d9-45100d764a87"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:05:42.269932 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:42.269908 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c63795c5-2763-48bc-b2d9-45100d764a87-kube-api-access-6qvbg" (OuterVolumeSpecName: "kube-api-access-6qvbg") pod "c63795c5-2763-48bc-b2d9-45100d764a87" (UID: "c63795c5-2763-48bc-b2d9-45100d764a87"). InnerVolumeSpecName "kube-api-access-6qvbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:05:42.369408 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:42.369372 2548 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c63795c5-2763-48bc-b2d9-45100d764a87-config-file\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:05:42.369408 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:42.369402 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qvbg\" (UniqueName: \"kubernetes.io/projected/c63795c5-2763-48bc-b2d9-45100d764a87-kube-api-access-6qvbg\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:05:43.107731 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:43.107705 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" Jul 18 01:05:43.108146 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:43.107700 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7txwn" event={"ID":"c63795c5-2763-48bc-b2d9-45100d764a87","Type":"ContainerDied","Data":"58842c4ba4d3f4e0e5ccd0e3d7c25e2c764fb085d3f0a5bd51413aecb42155ae"} Jul 18 01:05:43.108146 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:43.107838 2548 scope.go:117] "RemoveContainer" containerID="51c341bb3282f473cc759dc960459f84ad2b5e694dada1c73c8a8b83904acf4d" Jul 18 01:05:43.124499 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:43.124477 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7txwn"] Jul 18 01:05:43.128310 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:43.128285 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7txwn"] Jul 18 01:05:44.478560 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:44.478529 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c63795c5-2763-48bc-b2d9-45100d764a87" path="/var/lib/kubelet/pods/c63795c5-2763-48bc-b2d9-45100d764a87/volumes" Jul 18 01:05:46.733235 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.733202 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mrxns"] Jul 18 01:05:46.733761 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.733743 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c63795c5-2763-48bc-b2d9-45100d764a87" containerName="limitador" Jul 18 01:05:46.733853 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.733765 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="c63795c5-2763-48bc-b2d9-45100d764a87" containerName="limitador" Jul 18 01:05:46.733853 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.733787 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85456878-420b-4e44-a9ba-0bf29668aa9c" containerName="authorino" Jul 18 01:05:46.733853 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.733795 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="85456878-420b-4e44-a9ba-0bf29668aa9c" containerName="authorino" Jul 18 01:05:46.733993 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.733891 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="c63795c5-2763-48bc-b2d9-45100d764a87" containerName="limitador" Jul 18 01:05:46.733993 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.733903 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="85456878-420b-4e44-a9ba-0bf29668aa9c" containerName="authorino" Jul 18 01:05:46.738464 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.738445 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" Jul 18 01:05:46.741158 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.741135 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 18 01:05:46.741400 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.741381 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 18 01:05:46.742781 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.742758 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 18 01:05:46.742781 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.742772 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-dgnkb\"" Jul 18 01:05:46.745026 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.745009 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mrxns"] Jul 18 01:05:46.810075 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.810040 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e7ea81e-5e5f-4011-84b3-a3376e79c931-data\") pod \"postgres-69fb4594cf-mrxns\" (UID: \"3e7ea81e-5e5f-4011-84b3-a3376e79c931\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" Jul 18 01:05:46.810242 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.810131 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg55c\" (UniqueName: \"kubernetes.io/projected/3e7ea81e-5e5f-4011-84b3-a3376e79c931-kube-api-access-vg55c\") pod \"postgres-69fb4594cf-mrxns\" (UID: \"3e7ea81e-5e5f-4011-84b3-a3376e79c931\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" Jul 18 01:05:46.911451 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.911378 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e7ea81e-5e5f-4011-84b3-a3376e79c931-data\") pod \"postgres-69fb4594cf-mrxns\" (UID: \"3e7ea81e-5e5f-4011-84b3-a3376e79c931\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" Jul 18 01:05:46.911451 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.911447 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg55c\" (UniqueName: \"kubernetes.io/projected/3e7ea81e-5e5f-4011-84b3-a3376e79c931-kube-api-access-vg55c\") pod \"postgres-69fb4594cf-mrxns\" (UID: \"3e7ea81e-5e5f-4011-84b3-a3376e79c931\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" Jul 18 01:05:46.911778 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.911758 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e7ea81e-5e5f-4011-84b3-a3376e79c931-data\") pod \"postgres-69fb4594cf-mrxns\" (UID: \"3e7ea81e-5e5f-4011-84b3-a3376e79c931\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" Jul 18 01:05:46.920228 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:46.920201 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg55c\" (UniqueName: \"kubernetes.io/projected/3e7ea81e-5e5f-4011-84b3-a3376e79c931-kube-api-access-vg55c\") pod \"postgres-69fb4594cf-mrxns\" (UID: \"3e7ea81e-5e5f-4011-84b3-a3376e79c931\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" Jul 18 01:05:47.049273 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:47.049199 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" Jul 18 01:05:47.195366 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:47.195343 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mrxns"] Jul 18 01:05:47.197572 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:05:47.197530 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7ea81e_5e5f_4011_84b3_a3376e79c931.slice/crio-8c2a38aa8a0909b1e574a8a06ff9b05e0ea7360b29e1d04eb60b5ed9222f2493 WatchSource:0}: Error finding container 8c2a38aa8a0909b1e574a8a06ff9b05e0ea7360b29e1d04eb60b5ed9222f2493: Status 404 returned error can't find the container with id 8c2a38aa8a0909b1e574a8a06ff9b05e0ea7360b29e1d04eb60b5ed9222f2493 Jul 18 01:05:48.136987 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:48.136957 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" event={"ID":"3e7ea81e-5e5f-4011-84b3-a3376e79c931","Type":"ContainerStarted","Data":"8c2a38aa8a0909b1e574a8a06ff9b05e0ea7360b29e1d04eb60b5ed9222f2493"} Jul 18 01:05:53.173711 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:53.173619 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" event={"ID":"3e7ea81e-5e5f-4011-84b3-a3376e79c931","Type":"ContainerStarted","Data":"f407f0fd79743ae1aefc08bd1779773148edc75aef1546b9b54f64e1c6a02973"} Jul 18 01:05:53.174052 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:53.173709 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" Jul 18 01:05:53.190367 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:53.190321 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" podStartSLOduration=1.488810131 podStartE2EDuration="7.190307457s" totalImagesPullingTime="5.701497326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:05:53.1896907 +0000 UTC m=+535.246028238" watchObservedRunningTime="2026-07-18 01:05:53.190307457 +0000 UTC m=+535.246644987" Jul 18 01:05:59.207771 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:05:59.207743 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrxns" Jul 18 01:06:00.006878 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.006843 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cc88b9f55-nnl48"] Jul 18 01:06:00.013265 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.013242 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc88b9f55-nnl48" Jul 18 01:06:00.016003 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.015981 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 18 01:06:00.016824 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.016806 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cc88b9f55-nnl48"] Jul 18 01:06:00.129134 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.129078 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79cbf38b-63d8-49b7-9219-74ce54af7f57-tls-cert\") pod \"authorino-5cc88b9f55-nnl48\" (UID: \"79cbf38b-63d8-49b7-9219-74ce54af7f57\") " pod="kuadrant-system/authorino-5cc88b9f55-nnl48" Jul 18 01:06:00.129300 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.129233 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlcx7\" (UniqueName: \"kubernetes.io/projected/79cbf38b-63d8-49b7-9219-74ce54af7f57-kube-api-access-nlcx7\") pod \"authorino-5cc88b9f55-nnl48\" (UID: \"79cbf38b-63d8-49b7-9219-74ce54af7f57\") " pod="kuadrant-system/authorino-5cc88b9f55-nnl48" Jul 18 01:06:00.229900 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.229867 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlcx7\" (UniqueName: \"kubernetes.io/projected/79cbf38b-63d8-49b7-9219-74ce54af7f57-kube-api-access-nlcx7\") pod \"authorino-5cc88b9f55-nnl48\" (UID: \"79cbf38b-63d8-49b7-9219-74ce54af7f57\") " pod="kuadrant-system/authorino-5cc88b9f55-nnl48" Jul 18 01:06:00.230287 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.229927 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79cbf38b-63d8-49b7-9219-74ce54af7f57-tls-cert\") pod \"authorino-5cc88b9f55-nnl48\" (UID: \"79cbf38b-63d8-49b7-9219-74ce54af7f57\") " pod="kuadrant-system/authorino-5cc88b9f55-nnl48" Jul 18 01:06:00.232489 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.232466 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79cbf38b-63d8-49b7-9219-74ce54af7f57-tls-cert\") pod \"authorino-5cc88b9f55-nnl48\" (UID: \"79cbf38b-63d8-49b7-9219-74ce54af7f57\") " pod="kuadrant-system/authorino-5cc88b9f55-nnl48" Jul 18 01:06:00.237780 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.237760 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlcx7\" (UniqueName: \"kubernetes.io/projected/79cbf38b-63d8-49b7-9219-74ce54af7f57-kube-api-access-nlcx7\") pod \"authorino-5cc88b9f55-nnl48\" (UID: \"79cbf38b-63d8-49b7-9219-74ce54af7f57\") " pod="kuadrant-system/authorino-5cc88b9f55-nnl48" Jul 18 01:06:00.322936 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.322864 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc88b9f55-nnl48" Jul 18 01:06:00.451055 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:00.451023 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cc88b9f55-nnl48"] Jul 18 01:06:00.454581 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:06:00.454548 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79cbf38b_63d8_49b7_9219_74ce54af7f57.slice/crio-021e52ea27b51bd1dccc16e72cccbec9fa53dad95b600cafbe26a0a93ec8c09f WatchSource:0}: Error finding container 021e52ea27b51bd1dccc16e72cccbec9fa53dad95b600cafbe26a0a93ec8c09f: Status 404 returned error can't find the container with id 021e52ea27b51bd1dccc16e72cccbec9fa53dad95b600cafbe26a0a93ec8c09f Jul 18 01:06:01.212073 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:01.211978 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc88b9f55-nnl48" event={"ID":"79cbf38b-63d8-49b7-9219-74ce54af7f57","Type":"ContainerStarted","Data":"0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353"} Jul 18 01:06:01.212073 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:01.212014 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc88b9f55-nnl48" event={"ID":"79cbf38b-63d8-49b7-9219-74ce54af7f57","Type":"ContainerStarted","Data":"021e52ea27b51bd1dccc16e72cccbec9fa53dad95b600cafbe26a0a93ec8c09f"} Jul 18 01:06:01.227992 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:01.227935 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cc88b9f55-nnl48" podStartSLOduration=1.733503885 podStartE2EDuration="2.227918424s" totalImagesPullingTime="494.414539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:05:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:06:01.226385951 +0000 UTC m=+543.282723482" watchObservedRunningTime="2026-07-18 01:06:01.227918424 +0000 UTC m=+543.284255978" Jul 18 01:06:01.253181 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:01.253147 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q4m95"] Jul 18 01:06:01.253624 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:01.253325 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-q4m95" podUID="777f17ab-47e0-4a8b-bb42-2ab1874fe79a" containerName="authorino" containerID="cri-o://8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733" gracePeriod=30 Jul 18 01:06:01.504790 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:01.504766 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q4m95" Jul 18 01:06:01.644276 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:01.644239 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfn84\" (UniqueName: \"kubernetes.io/projected/777f17ab-47e0-4a8b-bb42-2ab1874fe79a-kube-api-access-hfn84\") pod \"777f17ab-47e0-4a8b-bb42-2ab1874fe79a\" (UID: \"777f17ab-47e0-4a8b-bb42-2ab1874fe79a\") " Jul 18 01:06:01.646545 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:01.646511 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777f17ab-47e0-4a8b-bb42-2ab1874fe79a-kube-api-access-hfn84" (OuterVolumeSpecName: "kube-api-access-hfn84") pod "777f17ab-47e0-4a8b-bb42-2ab1874fe79a" (UID: "777f17ab-47e0-4a8b-bb42-2ab1874fe79a"). InnerVolumeSpecName "kube-api-access-hfn84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:06:01.745347 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:01.745238 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfn84\" (UniqueName: \"kubernetes.io/projected/777f17ab-47e0-4a8b-bb42-2ab1874fe79a-kube-api-access-hfn84\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:06:02.217730 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:02.217689 2548 generic.go:356] "Generic (PLEG): container finished" podID="777f17ab-47e0-4a8b-bb42-2ab1874fe79a" containerID="8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733" exitCode=0 Jul 18 01:06:02.217871 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:02.217748 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q4m95" Jul 18 01:06:02.217871 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:02.217773 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q4m95" event={"ID":"777f17ab-47e0-4a8b-bb42-2ab1874fe79a","Type":"ContainerDied","Data":"8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733"} Jul 18 01:06:02.217871 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:02.217817 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q4m95" event={"ID":"777f17ab-47e0-4a8b-bb42-2ab1874fe79a","Type":"ContainerDied","Data":"6508c94f1a090bf56c9d803e1ce8e527d424aedf2c24b6bc98812af32dc4eed1"} Jul 18 01:06:02.217871 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:02.217833 2548 scope.go:117] "RemoveContainer" containerID="8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733" Jul 18 01:06:02.226936 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:02.226919 2548 scope.go:117] "RemoveContainer" containerID="8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733" Jul 18 01:06:02.227252 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:06:02.227235 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733\": container with ID starting with 8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733 not found: ID does not exist" containerID="8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733" Jul 18 01:06:02.227292 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:02.227260 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733"} err="failed to get container status \"8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733\": rpc error: code = NotFound desc = could not find container \"8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733\": container with ID starting with 8f01ea0b324b0de1fb8e920d080151f0069f8a0dc03d9b9c0daec64453b17733 not found: ID does not exist" Jul 18 01:06:02.238611 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:02.238559 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q4m95"] Jul 18 01:06:02.240479 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:02.240458 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q4m95"] Jul 18 01:06:02.478206 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:02.478135 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="777f17ab-47e0-4a8b-bb42-2ab1874fe79a" path="/var/lib/kubelet/pods/777f17ab-47e0-4a8b-bb42-2ab1874fe79a/volumes" Jul 18 01:06:05.782065 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.782032 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85f5f69f4b-rdxfm"] Jul 18 01:06:05.782573 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.782553 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="777f17ab-47e0-4a8b-bb42-2ab1874fe79a" containerName="authorino" Jul 18 01:06:05.782621 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.782575 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="777f17ab-47e0-4a8b-bb42-2ab1874fe79a" containerName="authorino" Jul 18 01:06:05.782682 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.782671 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="777f17ab-47e0-4a8b-bb42-2ab1874fe79a" containerName="authorino" Jul 18 01:06:05.940178 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.940144 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85f5f69f4b-rdxfm"] Jul 18 01:06:05.940334 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.940255 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:05.942978 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.942951 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qcg22\"" Jul 18 01:06:05.944279 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.944262 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 18 01:06:05.944346 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.944267 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 18 01:06:05.949447 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.949421 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6446d9c9c-fm65w"] Jul 18 01:06:05.992858 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.992829 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6446d9c9c-fm65w"] Jul 18 01:06:05.993025 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:05.992970 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6446d9c9c-fm65w" Jul 18 01:06:06.085649 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.085566 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqf9q\" (UniqueName: \"kubernetes.io/projected/3475044c-e9d0-4401-98d6-8090205ec7e5-kube-api-access-pqf9q\") pod \"maas-controller-85f5f69f4b-rdxfm\" (UID: \"3475044c-e9d0-4401-98d6-8090205ec7e5\") " pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:06.085649 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.085619 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp258\" (UniqueName: \"kubernetes.io/projected/17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0-kube-api-access-xp258\") pod \"maas-controller-6446d9c9c-fm65w\" (UID: \"17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0\") " pod="opendatahub/maas-controller-6446d9c9c-fm65w" Jul 18 01:06:06.085831 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.085692 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0-webhook-cert\") pod \"maas-controller-6446d9c9c-fm65w\" (UID: \"17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0\") " pod="opendatahub/maas-controller-6446d9c9c-fm65w" Jul 18 01:06:06.085831 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.085785 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3475044c-e9d0-4401-98d6-8090205ec7e5-webhook-cert\") pod \"maas-controller-85f5f69f4b-rdxfm\" (UID: \"3475044c-e9d0-4401-98d6-8090205ec7e5\") " pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:06.186355 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.186325 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0-webhook-cert\") pod \"maas-controller-6446d9c9c-fm65w\" (UID: \"17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0\") " pod="opendatahub/maas-controller-6446d9c9c-fm65w" Jul 18 01:06:06.186530 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.186377 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3475044c-e9d0-4401-98d6-8090205ec7e5-webhook-cert\") pod \"maas-controller-85f5f69f4b-rdxfm\" (UID: \"3475044c-e9d0-4401-98d6-8090205ec7e5\") " pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:06.186530 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.186441 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqf9q\" (UniqueName: \"kubernetes.io/projected/3475044c-e9d0-4401-98d6-8090205ec7e5-kube-api-access-pqf9q\") pod \"maas-controller-85f5f69f4b-rdxfm\" (UID: \"3475044c-e9d0-4401-98d6-8090205ec7e5\") " pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:06.186530 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.186464 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp258\" (UniqueName: \"kubernetes.io/projected/17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0-kube-api-access-xp258\") pod \"maas-controller-6446d9c9c-fm65w\" (UID: \"17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0\") " pod="opendatahub/maas-controller-6446d9c9c-fm65w" Jul 18 01:06:06.188847 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.188822 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3475044c-e9d0-4401-98d6-8090205ec7e5-webhook-cert\") pod \"maas-controller-85f5f69f4b-rdxfm\" (UID: \"3475044c-e9d0-4401-98d6-8090205ec7e5\") " pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:06.188969 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.188955 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0-webhook-cert\") pod \"maas-controller-6446d9c9c-fm65w\" (UID: \"17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0\") " pod="opendatahub/maas-controller-6446d9c9c-fm65w" Jul 18 01:06:06.194546 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.194519 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp258\" (UniqueName: \"kubernetes.io/projected/17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0-kube-api-access-xp258\") pod \"maas-controller-6446d9c9c-fm65w\" (UID: \"17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0\") " pod="opendatahub/maas-controller-6446d9c9c-fm65w" Jul 18 01:06:06.194546 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.194523 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqf9q\" (UniqueName: \"kubernetes.io/projected/3475044c-e9d0-4401-98d6-8090205ec7e5-kube-api-access-pqf9q\") pod \"maas-controller-85f5f69f4b-rdxfm\" (UID: \"3475044c-e9d0-4401-98d6-8090205ec7e5\") " pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:06.251389 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.251354 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:06.303131 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.303077 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6446d9c9c-fm65w" Jul 18 01:06:06.409684 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.409655 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85f5f69f4b-rdxfm"] Jul 18 01:06:06.411555 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:06:06.411531 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3475044c_e9d0_4401_98d6_8090205ec7e5.slice/crio-28d8297d023a0bc9d640520b50e7e47d438faffedc2e243730fe455b32f4f170 WatchSource:0}: Error finding container 28d8297d023a0bc9d640520b50e7e47d438faffedc2e243730fe455b32f4f170: Status 404 returned error can't find the container with id 28d8297d023a0bc9d640520b50e7e47d438faffedc2e243730fe455b32f4f170 Jul 18 01:06:06.483268 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:06.483252 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6446d9c9c-fm65w"] Jul 18 01:06:06.485394 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:06:06.485365 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d61c98_2d1a_4f2a_9d9a_c6106c6c50c0.slice/crio-c786c2d8bb19d2e20dddbd66939eaffaf8715220ba5a583075268eb494d54e8f WatchSource:0}: Error finding container c786c2d8bb19d2e20dddbd66939eaffaf8715220ba5a583075268eb494d54e8f: Status 404 returned error can't find the container with id c786c2d8bb19d2e20dddbd66939eaffaf8715220ba5a583075268eb494d54e8f Jul 18 01:06:07.245228 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:07.245189 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6446d9c9c-fm65w" event={"ID":"17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0","Type":"ContainerStarted","Data":"c786c2d8bb19d2e20dddbd66939eaffaf8715220ba5a583075268eb494d54e8f"} Jul 18 01:06:07.246628 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:07.246595 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" event={"ID":"3475044c-e9d0-4401-98d6-8090205ec7e5","Type":"ContainerStarted","Data":"28d8297d023a0bc9d640520b50e7e47d438faffedc2e243730fe455b32f4f170"} Jul 18 01:06:09.259009 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:09.258978 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6446d9c9c-fm65w" event={"ID":"17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0","Type":"ContainerStarted","Data":"a46f507c28f59d7069a4863de910fb849b5daf6bfb65d3599df3736700f6f14d"} Jul 18 01:06:09.259455 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:09.259142 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6446d9c9c-fm65w" Jul 18 01:06:09.260503 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:09.260482 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" event={"ID":"3475044c-e9d0-4401-98d6-8090205ec7e5","Type":"ContainerStarted","Data":"ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690"} Jul 18 01:06:09.260627 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:09.260570 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:09.280911 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:09.280871 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6446d9c9c-fm65w" podStartSLOduration=1.621329966 podStartE2EDuration="4.28085611s" totalImagesPullingTime="2.659526144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:06:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:06:09.280282332 +0000 UTC m=+551.336619865" watchObservedRunningTime="2026-07-18 01:06:09.28085611 +0000 UTC m=+551.337193668" Jul 18 01:06:09.310910 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:09.310863 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" podStartSLOduration=1.5870741910000001 podStartE2EDuration="4.310848535s" totalImagesPullingTime="2.723774344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:06:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:06:09.309671103 +0000 UTC m=+551.366008651" watchObservedRunningTime="2026-07-18 01:06:09.310848535 +0000 UTC m=+551.367186066" Jul 18 01:06:20.267156 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:20.267123 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:20.267616 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:20.267196 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6446d9c9c-fm65w" Jul 18 01:06:20.326580 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:20.326544 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85f5f69f4b-rdxfm"] Jul 18 01:06:20.326761 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:20.326715 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" podUID="3475044c-e9d0-4401-98d6-8090205ec7e5" containerName="manager" containerID="cri-o://ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690" gracePeriod=30 Jul 18 01:06:20.569531 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:20.569509 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:20.616958 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:20.616928 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqf9q\" (UniqueName: \"kubernetes.io/projected/3475044c-e9d0-4401-98d6-8090205ec7e5-kube-api-access-pqf9q\") pod \"3475044c-e9d0-4401-98d6-8090205ec7e5\" (UID: \"3475044c-e9d0-4401-98d6-8090205ec7e5\") " Jul 18 01:06:20.617087 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:20.616990 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3475044c-e9d0-4401-98d6-8090205ec7e5-webhook-cert\") pod \"3475044c-e9d0-4401-98d6-8090205ec7e5\" (UID: \"3475044c-e9d0-4401-98d6-8090205ec7e5\") " Jul 18 01:06:20.619222 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:20.619189 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3475044c-e9d0-4401-98d6-8090205ec7e5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3475044c-e9d0-4401-98d6-8090205ec7e5" (UID: "3475044c-e9d0-4401-98d6-8090205ec7e5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:06:20.619313 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:20.619294 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3475044c-e9d0-4401-98d6-8090205ec7e5-kube-api-access-pqf9q" (OuterVolumeSpecName: "kube-api-access-pqf9q") pod "3475044c-e9d0-4401-98d6-8090205ec7e5" (UID: "3475044c-e9d0-4401-98d6-8090205ec7e5"). InnerVolumeSpecName "kube-api-access-pqf9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:06:20.718176 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:20.718132 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqf9q\" (UniqueName: \"kubernetes.io/projected/3475044c-e9d0-4401-98d6-8090205ec7e5-kube-api-access-pqf9q\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:06:20.718176 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:20.718172 2548 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3475044c-e9d0-4401-98d6-8090205ec7e5-webhook-cert\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:06:21.319150 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:21.319087 2548 generic.go:356] "Generic (PLEG): container finished" podID="3475044c-e9d0-4401-98d6-8090205ec7e5" containerID="ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690" exitCode=0 Jul 18 01:06:21.319150 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:21.319139 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" Jul 18 01:06:21.319641 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:21.319201 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" event={"ID":"3475044c-e9d0-4401-98d6-8090205ec7e5","Type":"ContainerDied","Data":"ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690"} Jul 18 01:06:21.319641 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:21.319269 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f5f69f4b-rdxfm" event={"ID":"3475044c-e9d0-4401-98d6-8090205ec7e5","Type":"ContainerDied","Data":"28d8297d023a0bc9d640520b50e7e47d438faffedc2e243730fe455b32f4f170"} Jul 18 01:06:21.319641 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:21.319303 2548 scope.go:117] "RemoveContainer" containerID="ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690" Jul 18 01:06:21.328532 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:21.328359 2548 scope.go:117] "RemoveContainer" containerID="ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690" Jul 18 01:06:21.328658 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:06:21.328638 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690\": container with ID starting with ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690 not found: ID does not exist" containerID="ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690" Jul 18 01:06:21.328704 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:21.328666 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690"} err="failed to get container status \"ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690\": rpc error: code = NotFound desc = could not find container \"ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690\": container with ID starting with ebf8ee9838735a8b2f5c18806ae6ee4bec2997f9a7b2f4f2fd9753e4bf8f2690 not found: ID does not exist" Jul 18 01:06:21.341280 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:21.341251 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85f5f69f4b-rdxfm"] Jul 18 01:06:21.345621 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:21.345600 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85f5f69f4b-rdxfm"] Jul 18 01:06:22.477907 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:22.477873 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3475044c-e9d0-4401-98d6-8090205ec7e5" path="/var/lib/kubelet/pods/3475044c-e9d0-4401-98d6-8090205ec7e5/volumes" Jul 18 01:06:40.009360 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.009327 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl"] Jul 18 01:06:40.009722 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.009696 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3475044c-e9d0-4401-98d6-8090205ec7e5" containerName="manager" Jul 18 01:06:40.009722 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.009710 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="3475044c-e9d0-4401-98d6-8090205ec7e5" containerName="manager" Jul 18 01:06:40.009815 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.009802 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="3475044c-e9d0-4401-98d6-8090205ec7e5" containerName="manager" Jul 18 01:06:40.017644 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.017625 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.021217 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.021190 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hplzz\"" Jul 18 01:06:40.021335 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.021195 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 18 01:06:40.023381 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.023360 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl"] Jul 18 01:06:40.093907 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.093877 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-openshift-service-ca\") pod \"maas-api-9b996f5d7-gb5rl\" (UID: \"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a\") " pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.094064 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.093917 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-maas-api-tls\") pod \"maas-api-9b996f5d7-gb5rl\" (UID: \"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a\") " pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.094064 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.093949 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wkcf\" (UniqueName: \"kubernetes.io/projected/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-kube-api-access-9wkcf\") pod \"maas-api-9b996f5d7-gb5rl\" (UID: \"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a\") " pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.195365 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.195325 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wkcf\" (UniqueName: \"kubernetes.io/projected/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-kube-api-access-9wkcf\") pod \"maas-api-9b996f5d7-gb5rl\" (UID: \"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a\") " pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.195560 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.195464 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-openshift-service-ca\") pod \"maas-api-9b996f5d7-gb5rl\" (UID: \"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a\") " pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.195560 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.195513 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-maas-api-tls\") pod \"maas-api-9b996f5d7-gb5rl\" (UID: \"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a\") " pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.195689 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:06:40.195668 2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 18 01:06:40.195778 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:06:40.195768 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-maas-api-tls podName:7193181e-3993-4a0c-8c8a-30e6bb2a8d7a nodeName:}" failed. No retries permitted until 2026-07-18 01:06:40.695743382 +0000 UTC m=+582.752080908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-maas-api-tls") pod "maas-api-9b996f5d7-gb5rl" (UID: "7193181e-3993-4a0c-8c8a-30e6bb2a8d7a") : secret "maas-api-serving-cert" not found Jul 18 01:06:40.196137 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.196120 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-openshift-service-ca\") pod \"maas-api-9b996f5d7-gb5rl\" (UID: \"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a\") " pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.206059 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.206032 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wkcf\" (UniqueName: \"kubernetes.io/projected/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-kube-api-access-9wkcf\") pod \"maas-api-9b996f5d7-gb5rl\" (UID: \"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a\") " pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.478547 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.478518 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-nrw46"] Jul 18 01:06:40.482430 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.482414 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" Jul 18 01:06:40.485391 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.485367 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 18 01:06:40.485803 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.485782 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-nrw46"] Jul 18 01:06:40.599539 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.599506 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4385848b-a9b9-4122-8410-d7f71d27ca18-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-nrw46\" (UID: \"4385848b-a9b9-4122-8410-d7f71d27ca18\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" Jul 18 01:06:40.599748 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.599726 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhlcq\" (UniqueName: \"kubernetes.io/projected/4385848b-a9b9-4122-8410-d7f71d27ca18-kube-api-access-xhlcq\") pod \"payload-pre-processing-7677b774bb-nrw46\" (UID: \"4385848b-a9b9-4122-8410-d7f71d27ca18\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" Jul 18 01:06:40.701053 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.701019 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-maas-api-tls\") pod \"maas-api-9b996f5d7-gb5rl\" (UID: \"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a\") " pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.701246 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.701067 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhlcq\" (UniqueName: \"kubernetes.io/projected/4385848b-a9b9-4122-8410-d7f71d27ca18-kube-api-access-xhlcq\") pod \"payload-pre-processing-7677b774bb-nrw46\" (UID: \"4385848b-a9b9-4122-8410-d7f71d27ca18\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" Jul 18 01:06:40.701246 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.701135 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4385848b-a9b9-4122-8410-d7f71d27ca18-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-nrw46\" (UID: \"4385848b-a9b9-4122-8410-d7f71d27ca18\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" Jul 18 01:06:40.701808 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.701782 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4385848b-a9b9-4122-8410-d7f71d27ca18-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-nrw46\" (UID: \"4385848b-a9b9-4122-8410-d7f71d27ca18\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" Jul 18 01:06:40.703678 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.703653 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7193181e-3993-4a0c-8c8a-30e6bb2a8d7a-maas-api-tls\") pod \"maas-api-9b996f5d7-gb5rl\" (UID: \"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a\") " pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.709616 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.709595 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhlcq\" (UniqueName: \"kubernetes.io/projected/4385848b-a9b9-4122-8410-d7f71d27ca18-kube-api-access-xhlcq\") pod \"payload-pre-processing-7677b774bb-nrw46\" (UID: \"4385848b-a9b9-4122-8410-d7f71d27ca18\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" Jul 18 01:06:40.795118 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.795021 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" Jul 18 01:06:40.927629 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.927608 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-nrw46"] Jul 18 01:06:40.928502 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:40.928468 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:40.929537 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:06:40.929514 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4385848b_a9b9_4122_8410_d7f71d27ca18.slice/crio-6d632aa32e9a2cb5e335e6183111bb604d2bfe8f8a83ce27cc14cb0b02dec11e WatchSource:0}: Error finding container 6d632aa32e9a2cb5e335e6183111bb604d2bfe8f8a83ce27cc14cb0b02dec11e: Status 404 returned error can't find the container with id 6d632aa32e9a2cb5e335e6183111bb604d2bfe8f8a83ce27cc14cb0b02dec11e Jul 18 01:06:41.070402 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:41.070379 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl"] Jul 18 01:06:41.072141 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:06:41.072079 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7193181e_3993_4a0c_8c8a_30e6bb2a8d7a.slice/crio-6e0d82682c03c922fd58aabeda55603038fc67b49b61d7618981245d09bf90fd WatchSource:0}: Error finding container 6e0d82682c03c922fd58aabeda55603038fc67b49b61d7618981245d09bf90fd: Status 404 returned error can't find the container with id 6e0d82682c03c922fd58aabeda55603038fc67b49b61d7618981245d09bf90fd Jul 18 01:06:41.428043 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:41.427954 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" event={"ID":"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a","Type":"ContainerStarted","Data":"6e0d82682c03c922fd58aabeda55603038fc67b49b61d7618981245d09bf90fd"} Jul 18 01:06:41.429162 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:41.429124 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" event={"ID":"4385848b-a9b9-4122-8410-d7f71d27ca18","Type":"ContainerStarted","Data":"6d632aa32e9a2cb5e335e6183111bb604d2bfe8f8a83ce27cc14cb0b02dec11e"} Jul 18 01:06:43.441013 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:43.440979 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" event={"ID":"7193181e-3993-4a0c-8c8a-30e6bb2a8d7a","Type":"ContainerStarted","Data":"0b95e22ab7e123ce92c1812ac33a0b5cde4391cdb9225c56a14269477f5eb054"} Jul 18 01:06:43.441485 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:43.441080 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:43.442589 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:43.442566 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" event={"ID":"4385848b-a9b9-4122-8410-d7f71d27ca18","Type":"ContainerStarted","Data":"25ab6fcb9e08cf93eab418ed3f5c3bc270f5155aa7387e54c0ed2bfc9e83c1e4"} Jul 18 01:06:43.442714 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:43.442627 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" Jul 18 01:06:43.458431 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:43.458387 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" podStartSLOduration=2.632675318 podStartE2EDuration="4.458374676s" totalImagesPullingTime="1.825699358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:06:43.456891967 +0000 UTC m=+585.513229511" watchObservedRunningTime="2026-07-18 01:06:43.458374676 +0000 UTC m=+585.514712206" Jul 18 01:06:43.472155 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:43.472120 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" podStartSLOduration=1.504030884 podStartE2EDuration="3.472107995s" totalImagesPullingTime="1.968077111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:06:43.471154488 +0000 UTC m=+585.527492020" watchObservedRunningTime="2026-07-18 01:06:43.472107995 +0000 UTC m=+585.528445517" Jul 18 01:06:49.452627 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:49.452593 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-9b996f5d7-gb5rl" Jul 18 01:06:54.449842 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:54.449812 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-nrw46" Jul 18 01:06:59.052927 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:59.052813 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovn-acl-logging/0.log" Jul 18 01:06:59.060068 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:06:59.054069 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovn-acl-logging/0.log" Jul 18 01:07:27.069643 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.069552 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8"] Jul 18 01:07:27.073389 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.073365 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.076763 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.076736 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vtlf8\"" Jul 18 01:07:27.077057 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.077037 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 18 01:07:27.078089 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.078068 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 18 01:07:27.086291 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.086271 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 18 01:07:27.089221 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.089199 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8"] Jul 18 01:07:27.206947 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.206921 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.207154 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.206958 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70340e4d-d63a-42be-b5ed-f67b677f3e09-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.207154 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.206977 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb6nq\" (UniqueName: \"kubernetes.io/projected/70340e4d-d63a-42be-b5ed-f67b677f3e09-kube-api-access-wb6nq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.207276 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.207167 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.207276 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.207209 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.207276 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.207259 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.308561 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.308533 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.308741 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.308569 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.308741 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.308598 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.308741 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.308628 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.308741 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.308652 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70340e4d-d63a-42be-b5ed-f67b677f3e09-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.308741 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.308667 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6nq\" (UniqueName: \"kubernetes.io/projected/70340e4d-d63a-42be-b5ed-f67b677f3e09-kube-api-access-wb6nq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.309055 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.309030 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.309055 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.309046 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.309180 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.309085 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.311107 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.311070 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70340e4d-d63a-42be-b5ed-f67b677f3e09-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.311249 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.311232 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70340e4d-d63a-42be-b5ed-f67b677f3e09-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.316538 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.316517 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb6nq\" (UniqueName: \"kubernetes.io/projected/70340e4d-d63a-42be-b5ed-f67b677f3e09-kube-api-access-wb6nq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cr2x8\" (UID: \"70340e4d-d63a-42be-b5ed-f67b677f3e09\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.383588 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.383514 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:27.515766 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.515640 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8"] Jul 18 01:07:27.517975 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:07:27.517948 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70340e4d_d63a_42be_b5ed_f67b677f3e09.slice/crio-2e922028c90a348fe4278ced61bee5ee428b6a35cc5b614dc26c7b44104f00c4 WatchSource:0}: Error finding container 2e922028c90a348fe4278ced61bee5ee428b6a35cc5b614dc26c7b44104f00c4: Status 404 returned error can't find the container with id 2e922028c90a348fe4278ced61bee5ee428b6a35cc5b614dc26c7b44104f00c4 Jul 18 01:07:27.646971 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:27.646894 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" event={"ID":"70340e4d-d63a-42be-b5ed-f67b677f3e09","Type":"ContainerStarted","Data":"2e922028c90a348fe4278ced61bee5ee428b6a35cc5b614dc26c7b44104f00c4"} Jul 18 01:07:29.657781 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:29.657740 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" event={"ID":"70340e4d-d63a-42be-b5ed-f67b677f3e09","Type":"ContainerStarted","Data":"ab5872bf433d2c997ed6f51b53c7190723d05eb32f75ffff68e1d7dfdccdad5f"} Jul 18 01:07:29.676336 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:29.676285 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" podStartSLOduration=1.397730248 podStartE2EDuration="2.676268973s" totalImagesPullingTime="1.278538725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:07:29.675241807 +0000 UTC m=+631.731579335" watchObservedRunningTime="2026-07-18 01:07:29.676268973 +0000 UTC m=+631.732606527" Jul 18 01:07:36.240217 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.240187 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj"] Jul 18 01:07:36.243907 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.243888 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.246728 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.246709 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 18 01:07:36.253632 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.253612 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj"] Jul 18 01:07:36.392505 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.392469 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.392672 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.392531 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxlhf\" (UniqueName: \"kubernetes.io/projected/ff0885df-36bc-44e9-bb57-450ea6dedb4f-kube-api-access-dxlhf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.392672 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.392599 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.392672 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.392654 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff0885df-36bc-44e9-bb57-450ea6dedb4f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.392800 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.392727 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.392800 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.392747 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.493449 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.493366 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.493449 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.493418 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxlhf\" (UniqueName: \"kubernetes.io/projected/ff0885df-36bc-44e9-bb57-450ea6dedb4f-kube-api-access-dxlhf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.493633 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.493595 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.493687 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.493631 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff0885df-36bc-44e9-bb57-450ea6dedb4f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.493743 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.493724 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.493796 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.493749 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.493796 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.493759 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.493961 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.493940 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.494108 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.494079 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.496020 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.495999 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff0885df-36bc-44e9-bb57-450ea6dedb4f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.496275 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.496259 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff0885df-36bc-44e9-bb57-450ea6dedb4f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.500870 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.500852 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxlhf\" (UniqueName: \"kubernetes.io/projected/ff0885df-36bc-44e9-bb57-450ea6dedb4f-kube-api-access-dxlhf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s7mkj\" (UID: \"ff0885df-36bc-44e9-bb57-450ea6dedb4f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.554881 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.554856 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:36.689642 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.689611 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj"] Jul 18 01:07:36.690901 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:07:36.690865 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0885df_36bc_44e9_bb57_450ea6dedb4f.slice/crio-44e5df7e186c4ed8d7f378828110ca80d26179afb6611d7598d4143127783082 WatchSource:0}: Error finding container 44e5df7e186c4ed8d7f378828110ca80d26179afb6611d7598d4143127783082: Status 404 returned error can't find the container with id 44e5df7e186c4ed8d7f378828110ca80d26179afb6611d7598d4143127783082 Jul 18 01:07:36.692442 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:36.692428 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 01:07:37.384542 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:37.384508 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:37.384998 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:37.384579 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:37.397240 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:37.397218 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:37.698168 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:37.698132 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" event={"ID":"ff0885df-36bc-44e9-bb57-450ea6dedb4f","Type":"ContainerStarted","Data":"17facb7efae002ad81e585c10d7a5738c1383de55645c1f6205995c16357d200"} Jul 18 01:07:37.698334 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:37.698200 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" event={"ID":"ff0885df-36bc-44e9-bb57-450ea6dedb4f","Type":"ContainerStarted","Data":"44e5df7e186c4ed8d7f378828110ca80d26179afb6611d7598d4143127783082"} Jul 18 01:07:37.709843 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:37.709816 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cr2x8" Jul 18 01:07:37.717260 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:37.717218 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" podStartSLOduration=1.547664525 podStartE2EDuration="1.717203957s" totalImagesPullingTime="169.539432ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:07:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:07:37.715573773 +0000 UTC m=+639.771911329" watchObservedRunningTime="2026-07-18 01:07:37.717203957 +0000 UTC m=+639.773541489" Jul 18 01:07:46.555966 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:46.555933 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:46.556379 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:46.555993 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:46.568701 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:46.568676 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:46.752761 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:46.752730 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s7mkj" Jul 18 01:07:47.694562 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.694518 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6"] Jul 18 01:07:47.701482 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.701460 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.704337 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.704320 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 18 01:07:47.709267 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.709240 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6"] Jul 18 01:07:47.792602 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.792569 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.792778 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.792630 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01b8a532-5332-4dc2-b2cd-72efb3e7885b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.792839 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.792820 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.792879 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.792841 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.792879 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.792866 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.792980 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.792882 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks9nz\" (UniqueName: \"kubernetes.io/projected/01b8a532-5332-4dc2-b2cd-72efb3e7885b-kube-api-access-ks9nz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.893570 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.893538 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.893570 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.893570 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks9nz\" (UniqueName: \"kubernetes.io/projected/01b8a532-5332-4dc2-b2cd-72efb3e7885b-kube-api-access-ks9nz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.893773 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.893611 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.893773 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.893636 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01b8a532-5332-4dc2-b2cd-72efb3e7885b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.893773 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.893732 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.893773 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.893759 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.894144 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.894121 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.894144 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.894133 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.894254 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.894206 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.896053 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.896035 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01b8a532-5332-4dc2-b2cd-72efb3e7885b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.896265 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.896245 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01b8a532-5332-4dc2-b2cd-72efb3e7885b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:47.901134 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:47.901112 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks9nz\" (UniqueName: \"kubernetes.io/projected/01b8a532-5332-4dc2-b2cd-72efb3e7885b-kube-api-access-ks9nz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6\" (UID: \"01b8a532-5332-4dc2-b2cd-72efb3e7885b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:48.015148 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:48.015023 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:48.147148 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:48.147085 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6"] Jul 18 01:07:48.149190 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:07:48.149167 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b8a532_5332_4dc2_b2cd_72efb3e7885b.slice/crio-a2fa6737a3468d8d968471c050d22a080e2f24f448dcf853cd250fce7478238c WatchSource:0}: Error finding container a2fa6737a3468d8d968471c050d22a080e2f24f448dcf853cd250fce7478238c: Status 404 returned error can't find the container with id a2fa6737a3468d8d968471c050d22a080e2f24f448dcf853cd250fce7478238c Jul 18 01:07:48.751791 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:48.751756 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" event={"ID":"01b8a532-5332-4dc2-b2cd-72efb3e7885b","Type":"ContainerStarted","Data":"afdc9be882541a26d84708e58e10b3fefdbfa1a3fc71274d651eb25862fe1070"} Jul 18 01:07:48.752235 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:48.751821 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" event={"ID":"01b8a532-5332-4dc2-b2cd-72efb3e7885b","Type":"ContainerStarted","Data":"a2fa6737a3468d8d968471c050d22a080e2f24f448dcf853cd250fce7478238c"} Jul 18 01:07:48.769941 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:48.769898 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" podStartSLOduration=1.57648293 podStartE2EDuration="1.769882713s" totalImagesPullingTime="193.399783ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:07:48.768088904 +0000 UTC m=+650.824426435" watchObservedRunningTime="2026-07-18 01:07:48.769882713 +0000 UTC m=+650.826220270" Jul 18 01:07:58.015662 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:58.015628 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:58.016198 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:58.015683 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:58.028290 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:58.028265 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:07:58.829970 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:07:58.829942 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6" Jul 18 01:08:48.613736 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:48.613704 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cc88b9f55-nnl48"] Jul 18 01:08:48.614297 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:48.613927 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5cc88b9f55-nnl48" podUID="79cbf38b-63d8-49b7-9219-74ce54af7f57" containerName="authorino" containerID="cri-o://0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353" gracePeriod=30 Jul 18 01:08:48.873394 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:48.873340 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc88b9f55-nnl48" Jul 18 01:08:48.976648 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:48.976617 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79cbf38b-63d8-49b7-9219-74ce54af7f57-tls-cert\") pod \"79cbf38b-63d8-49b7-9219-74ce54af7f57\" (UID: \"79cbf38b-63d8-49b7-9219-74ce54af7f57\") " Jul 18 01:08:48.976805 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:48.976679 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlcx7\" (UniqueName: \"kubernetes.io/projected/79cbf38b-63d8-49b7-9219-74ce54af7f57-kube-api-access-nlcx7\") pod \"79cbf38b-63d8-49b7-9219-74ce54af7f57\" (UID: \"79cbf38b-63d8-49b7-9219-74ce54af7f57\") " Jul 18 01:08:48.978895 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:48.978871 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79cbf38b-63d8-49b7-9219-74ce54af7f57-kube-api-access-nlcx7" (OuterVolumeSpecName: "kube-api-access-nlcx7") pod "79cbf38b-63d8-49b7-9219-74ce54af7f57" (UID: "79cbf38b-63d8-49b7-9219-74ce54af7f57"). InnerVolumeSpecName "kube-api-access-nlcx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:08:48.987686 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:48.987662 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79cbf38b-63d8-49b7-9219-74ce54af7f57-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "79cbf38b-63d8-49b7-9219-74ce54af7f57" (UID: "79cbf38b-63d8-49b7-9219-74ce54af7f57"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:08:49.063326 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:49.063293 2548 generic.go:356] "Generic (PLEG): container finished" podID="79cbf38b-63d8-49b7-9219-74ce54af7f57" containerID="0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353" exitCode=0 Jul 18 01:08:49.063460 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:49.063333 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc88b9f55-nnl48" Jul 18 01:08:49.063460 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:49.063382 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc88b9f55-nnl48" event={"ID":"79cbf38b-63d8-49b7-9219-74ce54af7f57","Type":"ContainerDied","Data":"0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353"} Jul 18 01:08:49.063460 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:49.063416 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc88b9f55-nnl48" event={"ID":"79cbf38b-63d8-49b7-9219-74ce54af7f57","Type":"ContainerDied","Data":"021e52ea27b51bd1dccc16e72cccbec9fa53dad95b600cafbe26a0a93ec8c09f"} Jul 18 01:08:49.063460 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:49.063431 2548 scope.go:117] "RemoveContainer" containerID="0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353" Jul 18 01:08:49.073041 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:49.073021 2548 scope.go:117] "RemoveContainer" containerID="0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353" Jul 18 01:08:49.073327 ip-10-0-140-116 kubenswrapper[2548]: E0718 01:08:49.073306 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353\": container with ID starting with 0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353 not found: ID does not exist" containerID="0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353" Jul 18 01:08:49.073398 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:49.073335 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353"} err="failed to get container status \"0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353\": rpc error: code = NotFound desc = could not find container \"0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353\": container with ID starting with 0aba5278c341765691b8d2f0104c8dc49bfb99d4b0d546f98d69e327ca2a0353 not found: ID does not exist" Jul 18 01:08:49.077838 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:49.077818 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlcx7\" (UniqueName: \"kubernetes.io/projected/79cbf38b-63d8-49b7-9219-74ce54af7f57-kube-api-access-nlcx7\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:08:49.077917 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:49.077840 2548 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79cbf38b-63d8-49b7-9219-74ce54af7f57-tls-cert\") on node \"ip-10-0-140-116.ec2.internal\" DevicePath \"\"" Jul 18 01:08:49.100858 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:49.100831 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cc88b9f55-nnl48"] Jul 18 01:08:49.105060 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:49.105041 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5cc88b9f55-nnl48"] Jul 18 01:08:50.479504 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:08:50.479438 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79cbf38b-63d8-49b7-9219-74ce54af7f57" path="/var/lib/kubelet/pods/79cbf38b-63d8-49b7-9219-74ce54af7f57/volumes" Jul 18 01:09:34.175036 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:34.174998 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6446d9c9c-fm65w_17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0/manager/0.log" Jul 18 01:09:34.773313 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:34.773284 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5c9c876d-h7vq4_d5c573f9-4847-444c-b906-3016d2c752b2/copy-manifests/0.log" Jul 18 01:09:34.785844 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:34.785819 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5c9c876d-h7vq4_d5c573f9-4847-444c-b906-3016d2c752b2/manager/0.log" Jul 18 01:09:35.105716 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:35.105624 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-9b996f5d7-gb5rl_7193181e-3993-4a0c-8c8a-30e6bb2a8d7a/maas-api/0.log" Jul 18 01:09:35.214648 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:35.214621 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-mrxns_3e7ea81e-5e5f-4011-84b3-a3376e79c931/postgres/0.log" Jul 18 01:09:37.880731 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:37.880708 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595565d58b-z5lwj_416e82ff-ebca-44c6-830c-bbcdbe551f4c/kube-auth-proxy/0.log" Jul 18 01:09:38.100376 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:38.100346 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-nrw46_4385848b-a9b9-4122-8410-d7f71d27ca18/payload-pre-processing/0.log" Jul 18 01:09:38.741302 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:38.741270 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cr2x8_70340e4d-d63a-42be-b5ed-f67b677f3e09/main/0.log" Jul 18 01:09:38.846466 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:38.846425 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-s7mkj_ff0885df-36bc-44e9-bb57-450ea6dedb4f/main/0.log" Jul 18 01:09:38.958002 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:38.957970 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjnmq6_01b8a532-5332-4dc2-b2cd-72efb3e7885b/main/0.log" Jul 18 01:09:47.237738 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:47.237706 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cggnq_db80b378-dd0f-4823-83b6-f7b2596fa989/global-pull-secret-syncer/0.log" Jul 18 01:09:47.339168 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:47.339143 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gzsm5_bced967c-ed04-4dbe-bdbf-c631f9c7d849/konnectivity-agent/0.log" Jul 18 01:09:47.381663 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:47.381629 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-116.ec2.internal_52b0e16400b201ca7843df9c2c64cd1a/haproxy/0.log" Jul 18 01:09:53.793345 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:53.793317 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94994cb-7d73-45fd-8d50-acacba46d495/alertmanager/0.log" Jul 18 01:09:53.814017 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:53.813995 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94994cb-7d73-45fd-8d50-acacba46d495/config-reloader/0.log" Jul 18 01:09:53.834562 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:53.834542 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94994cb-7d73-45fd-8d50-acacba46d495/kube-rbac-proxy-web/0.log" Jul 18 01:09:53.862253 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:53.862230 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94994cb-7d73-45fd-8d50-acacba46d495/kube-rbac-proxy/0.log" Jul 18 01:09:53.882595 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:53.882577 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94994cb-7d73-45fd-8d50-acacba46d495/kube-rbac-proxy-metric/0.log" Jul 18 01:09:53.903508 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:53.903494 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94994cb-7d73-45fd-8d50-acacba46d495/prom-label-proxy/0.log" Jul 18 01:09:53.928501 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:53.928484 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94994cb-7d73-45fd-8d50-acacba46d495/init-config-reloader/0.log" Jul 18 01:09:53.989837 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:53.989816 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-zz58v_9387f2c5-b3ac-40a4-96f0-832d23cbc39c/kube-state-metrics/0.log" Jul 18 01:09:54.033370 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.033344 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-zz58v_9387f2c5-b3ac-40a4-96f0-832d23cbc39c/kube-rbac-proxy-main/0.log" Jul 18 01:09:54.053241 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.053179 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-zz58v_9387f2c5-b3ac-40a4-96f0-832d23cbc39c/kube-rbac-proxy-self/0.log" Jul 18 01:09:54.083007 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.082983 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68f989576b-bk4f7_55954dc2-9545-4661-9da1-16831d88873b/metrics-server/0.log" Jul 18 01:09:54.123982 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.123961 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-gdvgs_0c3cd76c-2ce6-495d-991a-17c400364d38/monitoring-plugin/0.log" Jul 18 01:09:54.281366 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.281341 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lt26n_aac263c9-741b-4718-8baa-0eaacb6bed7b/node-exporter/0.log" Jul 18 01:09:54.300341 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.300317 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lt26n_aac263c9-741b-4718-8baa-0eaacb6bed7b/kube-rbac-proxy/0.log" Jul 18 01:09:54.322694 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.322634 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lt26n_aac263c9-741b-4718-8baa-0eaacb6bed7b/init-textfile/0.log" Jul 18 01:09:54.453226 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.453197 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wrqlt_471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd/kube-rbac-proxy-main/0.log" Jul 18 01:09:54.483903 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.483876 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wrqlt_471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd/kube-rbac-proxy-self/0.log" Jul 18 01:09:54.533030 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.533009 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wrqlt_471ef1bb-c97f-4f39-a28f-0fe8edc6d0dd/openshift-state-metrics/0.log" Jul 18 01:09:54.577120 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.577048 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_572fb4f4-0259-410e-afcf-df0ef75ec24a/prometheus/0.log" Jul 18 01:09:54.599938 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.599918 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_572fb4f4-0259-410e-afcf-df0ef75ec24a/config-reloader/0.log" Jul 18 01:09:54.621811 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.621788 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_572fb4f4-0259-410e-afcf-df0ef75ec24a/thanos-sidecar/0.log" Jul 18 01:09:54.642501 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.642477 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_572fb4f4-0259-410e-afcf-df0ef75ec24a/kube-rbac-proxy-web/0.log" Jul 18 01:09:54.662047 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.662016 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_572fb4f4-0259-410e-afcf-df0ef75ec24a/kube-rbac-proxy/0.log" Jul 18 01:09:54.681737 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.681716 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_572fb4f4-0259-410e-afcf-df0ef75ec24a/kube-rbac-proxy-thanos/0.log" Jul 18 01:09:54.702716 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.702696 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_572fb4f4-0259-410e-afcf-df0ef75ec24a/init-config-reloader/0.log" Jul 18 01:09:54.732356 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.732336 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-8b7zn_5c82ad08-33a5-4f23-90ab-b433f97ef71b/prometheus-operator/0.log" Jul 18 01:09:54.752736 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.752722 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-8b7zn_5c82ad08-33a5-4f23-90ab-b433f97ef71b/kube-rbac-proxy/0.log" Jul 18 01:09:54.776497 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.776482 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-94hgd_25843a1a-e569-42ca-be3e-28282c27b2e0/prometheus-operator-admission-webhook/0.log" Jul 18 01:09:54.812363 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.812336 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67c55bdc5f-2rpp5_9413c535-cf91-440c-91fb-fdd2e1327589/telemeter-client/0.log" Jul 18 01:09:54.833790 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.833735 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67c55bdc5f-2rpp5_9413c535-cf91-440c-91fb-fdd2e1327589/reload/0.log" Jul 18 01:09:54.854239 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.854221 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67c55bdc5f-2rpp5_9413c535-cf91-440c-91fb-fdd2e1327589/kube-rbac-proxy/0.log" Jul 18 01:09:54.890640 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.890617 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846698548f-6vzqk_62af278d-007d-40d4-9d2c-20f79269a9f9/thanos-query/0.log" Jul 18 01:09:54.911980 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.911959 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846698548f-6vzqk_62af278d-007d-40d4-9d2c-20f79269a9f9/kube-rbac-proxy-web/0.log" Jul 18 01:09:54.932712 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.932692 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846698548f-6vzqk_62af278d-007d-40d4-9d2c-20f79269a9f9/kube-rbac-proxy/0.log" Jul 18 01:09:54.960002 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.959982 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846698548f-6vzqk_62af278d-007d-40d4-9d2c-20f79269a9f9/prom-label-proxy/0.log" Jul 18 01:09:54.983950 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:54.983914 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846698548f-6vzqk_62af278d-007d-40d4-9d2c-20f79269a9f9/kube-rbac-proxy-rules/0.log" Jul 18 01:09:55.003750 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:55.003722 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846698548f-6vzqk_62af278d-007d-40d4-9d2c-20f79269a9f9/kube-rbac-proxy-metrics/0.log" Jul 18 01:09:57.533515 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.533487 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-hcmms_63c31aba-3452-4939-bdbf-3342b21d06b6/download-server/0.log" Jul 18 01:09:57.739072 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.739037 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw"] Jul 18 01:09:57.739638 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.739611 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79cbf38b-63d8-49b7-9219-74ce54af7f57" containerName="authorino" Jul 18 01:09:57.739638 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.739631 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="79cbf38b-63d8-49b7-9219-74ce54af7f57" containerName="authorino" Jul 18 01:09:57.739789 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.739707 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="79cbf38b-63d8-49b7-9219-74ce54af7f57" containerName="authorino" Jul 18 01:09:57.742904 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.742886 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.745649 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.745630 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d2659\"/\"kube-root-ca.crt\"" Jul 18 01:09:57.747032 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.747011 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d2659\"/\"default-dockercfg-drqk9\"" Jul 18 01:09:57.747032 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.747027 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d2659\"/\"openshift-service-ca.crt\"" Jul 18 01:09:57.749192 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.749173 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw"] Jul 18 01:09:57.838937 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.838858 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbls7\" (UniqueName: \"kubernetes.io/projected/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-kube-api-access-rbls7\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.838937 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.838894 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-podres\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.838937 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.838926 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-proc\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.839213 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.838990 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-lib-modules\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.839213 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.839063 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-sys\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.940065 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.940031 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbls7\" (UniqueName: \"kubernetes.io/projected/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-kube-api-access-rbls7\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.940266 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.940078 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-podres\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.940266 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.940145 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-proc\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.940266 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.940183 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-lib-modules\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.940266 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.940254 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-proc\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.940448 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.940263 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-sys\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.940448 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.940291 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-podres\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.940448 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.940318 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-sys\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.940448 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.940384 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-lib-modules\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:57.948686 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:57.948665 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbls7\" (UniqueName: \"kubernetes.io/projected/4325f3b5-ca3c-4096-a43a-df9587ac5ba1-kube-api-access-rbls7\") pod \"perf-node-gather-daemonset-qzmjw\" (UID: \"4325f3b5-ca3c-4096-a43a-df9587ac5ba1\") " pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:58.054961 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:58.054925 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:58.191311 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:58.191188 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw"] Jul 18 01:09:58.194000 ip-10-0-140-116 kubenswrapper[2548]: W0718 01:09:58.193966 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4325f3b5_ca3c_4096_a43a_df9587ac5ba1.slice/crio-673392bdcfbafa62ec7cdcdcc01733ce7757109827e806d779d79b18148bca64 WatchSource:0}: Error finding container 673392bdcfbafa62ec7cdcdcc01733ce7757109827e806d779d79b18148bca64: Status 404 returned error can't find the container with id 673392bdcfbafa62ec7cdcdcc01733ce7757109827e806d779d79b18148bca64 Jul 18 01:09:58.406288 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:58.406208 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" event={"ID":"4325f3b5-ca3c-4096-a43a-df9587ac5ba1","Type":"ContainerStarted","Data":"260148ebf0eb1f4c71ce1b2edd79ea73e9e23cc1e85c1808c46b6071bbb120c5"} Jul 18 01:09:58.406288 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:58.406263 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" event={"ID":"4325f3b5-ca3c-4096-a43a-df9587ac5ba1","Type":"ContainerStarted","Data":"673392bdcfbafa62ec7cdcdcc01733ce7757109827e806d779d79b18148bca64"} Jul 18 01:09:58.406477 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:58.406338 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:09:58.422402 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:58.422359 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" podStartSLOduration=1.422344789 podStartE2EDuration="1.422344789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:09:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:09:58.421508443 +0000 UTC m=+780.477845972" watchObservedRunningTime="2026-07-18 01:09:58.422344789 +0000 UTC m=+780.478682335" Jul 18 01:09:59.331700 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:59.331674 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4z79s_4145ebda-7b42-4bd9-84c1-b6368398cdcf/dns/0.log" Jul 18 01:09:59.350976 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:59.350952 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4z79s_4145ebda-7b42-4bd9-84c1-b6368398cdcf/kube-rbac-proxy/0.log" Jul 18 01:09:59.421524 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:09:59.421498 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4cvp2_56960201-977c-4199-ae5c-609f7b8e79e8/dns-node-resolver/0.log" Jul 18 01:10:00.020610 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:00.020584 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fpxss_f129dca4-c3bb-40b4-96ce-1c13165d56b9/node-ca/0.log" Jul 18 01:10:01.064574 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:01.064546 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595565d58b-z5lwj_416e82ff-ebca-44c6-830c-bbcdbe551f4c/kube-auth-proxy/0.log" Jul 18 01:10:01.121778 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:01.121754 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-nrw46_4385848b-a9b9-4122-8410-d7f71d27ca18/payload-pre-processing/0.log" Jul 18 01:10:01.948003 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:01.947980 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q7xcl_e9ea6b45-15e9-468b-b258-acffbeedb347/serve-healthcheck-canary/0.log" Jul 18 01:10:02.521155 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:02.521124 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g5j2n_cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa/kube-rbac-proxy/0.log" Jul 18 01:10:02.540831 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:02.540805 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g5j2n_cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa/exporter/0.log" Jul 18 01:10:02.561011 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:02.560983 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g5j2n_cfe5bbb3-dc8d-46e1-8d8c-76500ba388aa/extractor/0.log" Jul 18 01:10:04.421559 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:04.421526 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d2659/perf-node-gather-daemonset-qzmjw" Jul 18 01:10:04.793785 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:04.793755 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6446d9c9c-fm65w_17d61c98-2d1a-4f2a-9d9a-c6106c6c50c0/manager/0.log" Jul 18 01:10:05.022774 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:05.022744 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5c9c876d-h7vq4_d5c573f9-4847-444c-b906-3016d2c752b2/manager/0.log" Jul 18 01:10:05.038508 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:05.038486 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5c9c876d-h7vq4_d5c573f9-4847-444c-b906-3016d2c752b2/copy-manifests/0.log" Jul 18 01:10:06.200470 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:06.200439 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-587945cbf9-2mrxs_acc2a270-51c2-4233-9b38-cfc6acc409e0/manager/0.log" Jul 18 01:10:08.272619 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:08.272579 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595565d58b-z5lwj_416e82ff-ebca-44c6-830c-bbcdbe551f4c/kube-auth-proxy/0.log" Jul 18 01:10:08.306490 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:08.306464 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-nrw46_4385848b-a9b9-4122-8410-d7f71d27ca18/payload-pre-processing/0.log" Jul 18 01:10:09.626771 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:09.626743 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595565d58b-z5lwj_416e82ff-ebca-44c6-830c-bbcdbe551f4c/kube-auth-proxy/0.log" Jul 18 01:10:09.661918 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:09.661842 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-nrw46_4385848b-a9b9-4122-8410-d7f71d27ca18/payload-pre-processing/0.log" Jul 18 01:10:13.198398 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:13.198371 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmhnr_b2c9c9d1-8d69-48ab-9569-4ee8760189d3/kube-multus-additional-cni-plugins/0.log" Jul 18 01:10:13.217598 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:13.217575 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmhnr_b2c9c9d1-8d69-48ab-9569-4ee8760189d3/egress-router-binary-copy/0.log" Jul 18 01:10:13.238938 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:13.238916 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmhnr_b2c9c9d1-8d69-48ab-9569-4ee8760189d3/cni-plugins/0.log" Jul 18 01:10:13.258754 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:13.258733 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmhnr_b2c9c9d1-8d69-48ab-9569-4ee8760189d3/bond-cni-plugin/0.log" Jul 18 01:10:13.278968 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:13.278944 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmhnr_b2c9c9d1-8d69-48ab-9569-4ee8760189d3/routeoverride-cni/0.log" Jul 18 01:10:13.300835 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:13.300813 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmhnr_b2c9c9d1-8d69-48ab-9569-4ee8760189d3/whereabouts-cni-bincopy/0.log" Jul 18 01:10:13.322131 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:13.322105 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmhnr_b2c9c9d1-8d69-48ab-9569-4ee8760189d3/whereabouts-cni/0.log" Jul 18 01:10:13.383352 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:13.383323 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hrn8p_67fb3091-553a-40ed-bd3e-aad25bd36051/kube-multus/0.log" Jul 18 01:10:13.523498 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:13.523425 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tsk8r_2a03b934-a48a-4a2d-a72c-11faf54565e1/network-metrics-daemon/0.log" Jul 18 01:10:13.545467 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:13.545439 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tsk8r_2a03b934-a48a-4a2d-a72c-11faf54565e1/kube-rbac-proxy/0.log" Jul 18 01:10:14.754795 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:14.754763 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovn-controller/0.log" Jul 18 01:10:14.773424 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:14.773397 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovn-acl-logging/1.log" Jul 18 01:10:14.773537 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:14.773498 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovn-acl-logging/0.log" Jul 18 01:10:14.790448 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:14.790424 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/kube-rbac-proxy-node/0.log" Jul 18 01:10:14.816919 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:14.816897 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/kube-rbac-proxy-ovn-metrics/0.log" Jul 18 01:10:14.837656 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:14.837639 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/northd/0.log" Jul 18 01:10:14.858465 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:14.858448 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/nbdb/0.log" Jul 18 01:10:14.878594 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:14.878575 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/sbdb/0.log" Jul 18 01:10:14.916247 ip-10-0-140-116 kubenswrapper[2548]: I0718 01:10:14.916229 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8r2t_3930b07b-fdef-4e96-822b-ef433209ee78/ovnkube-controller/0.log"